User interface for payments

ABSTRACT

The present disclosure relates to making payments with a mobile device. In one example process, the mobile device receives and stores information for one or more payment accounts on the mobile device. The mobile device is used to make payments using the payment accounts. In some examples, authorization to proceed with a payment is performed before each purchase made by the user. The authorization process can include receiving a verification of the user, such as a fingerprint scan or passcode. In some examples, a payment account is selected from among available payment accounts. In some examples, an indication is displayed of a digital item associated with a purchased item. In some examples, a payment transaction is initiated with participants of an ongoing communication. In some examples, an application of a retailer is invoked based on the availability of the application. In some examples, a purchase recommendation is provided.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to U.S. patent application Ser. No.15/992,722, entitled “USER INTERFACE FOR PAYMENTS,” filed May 30, 2018,which claims priority to U.S. patent application Ser. No. 14/503,072,entitled “USER INTERFACE FOR PAYMENTS,” filed Sep. 30, 2014, whichclaims priority to U.S. Provisional Application Ser. No. 62/004,886,entitled “USER INTERFACE FOR PAYMENTS,” filed May 29, 2014, and U.S.Provisional Application Ser. No. 62/047,545, entitled “USER INTERFACEFOR PAYMENTS,” filed Sep. 8, 2014. The contents of each of theseapplications are hereby incorporated by reference in their entireties.

This application relates to the following co-pending provisionalapplications: U.S. Patent Application Ser. No. 61/912,727, entitled“PROVISIONING AND AUTHENTICATING CREDENTIALS ON AN ELECTRONIC DEVICE”,filed Dec. 6, 2013, (Reference No. P19543USP1); U.S. Patent ApplicationSer. No. 61/909,717, entitled “PROVISIONING OF CREDENTIALS ON ANELECTRONIC DEVICE USING PASSWORDS COMMUNICATED OVER VERIFIED CHANNELS”,filed Nov. 27, 2013, (Reference No. P19950USP1); U.S. Patent ApplicationSer. No. 62/004,182, entitled “ONLINE PAYMENTS USING A SECURE ELEMENT OFAN ELECTRONIC DEVICE”, filed May 28, 2014, (Reference No. P20450USP4);U.S. Patent Application Ser. No. 61/920,029, entitled “DELETION OFCREDENTIALS FROM AN ELECTRONIC DEVICE”, filed Dec. 23, 2013, (ReferenceNo. P21084USP1); U.S. Patent Application Ser. No. 61/899,737, entitled“USING BIOAUTHENTICATION IN NEAR-FIELD-COMMUNICATION TRANSACTIONS”,filed Nov. 4, 2013, (Reference No. P21646USP1); U.S. Patent ApplicationSer. No. 61/905,035, entitled “GENERATING TRANSACTION IDENTIFIERS”,filed Nov. 15, 2013, (Reference No. P21714USP1); U.S. Patent ApplicationSer. No. 61/905,042, entitled “ELECTRONIC RECEIPTS FOR NFC-BASEDFINANCIAL TRANSACTIONS”, filed Nov. 15, 2013, (Reference No. 21734USP1);U.S. Patent Application Ser. No. 62/004,798, entitled“FINANCIAL-TRANSACTION NOTIFICATIONS”, filed May 29, 2014, (ReferenceNo. P23211USP1); U.S. Patent Application Ser. No. 62/004,837, entitled“METHODS FOR MANAGING PAYMENT APPLETS ON A SECURE ELEMENT TO CONDUCTMOBILE PAYMENT TRANSACTIONS”, filed May 29, 2014, (Reference No.P23215USP1); U.S. Patent Application Ser. No. 62/004,840, entitled“METHODS FOR OPERATING A PORTABLE ELECTRONIC DEVICE TO CONDUCT MOBILEPAYMENT TRANSACTIONS”, filed May 29, 2014, (Reference No. P23223USP1);U.S. Patent Application Ser. No. 62/004,835, entitled “METHODS FOR USINGA PRIMARY USER DEVICE TO PROVISION CREDENTIALS ONTO A SECONDARY USERDEVICE”, filed May 29, 2014, (Reference No. P23224USP1); U.S. PatentApplication Ser. No. 62/004,832, entitled “METHODS FOR USING A RANDOMAUTHORIZATION NUMBER TO PROVIDE ENHANCED SECURITY FOR A SECURE ELEMENT”,filed May 29, 2014, (Reference No. P23261USP1); U.S. Patent ApplicationSer. No. 62/004,338, entitled “USER DEVICE SECURE PARTICIPATION INTRANSACTIONS VIA LOCAL SECURE ELEMENT DETECTION OF MECHANICAL INPUT”,filed May 29, 2014, (Reference No. P22931USP1); and U.S. Utility patentapplication Ser. No. 14/092,205, entitled “SECURE PROVISIONING OFCREDENTIALS ON AN ELECTRONIC DEVICE”, filed Nov. 27, 2013, (ReferenceNo. P19545US1); which are hereby incorporated by reference in theirentirety.

TECHNICAL FIELD

This relates generally to electronic devices for making paymenttransactions, including but not limited to electronic devices for usewith contactless payment systems and payments over the Internet.

BACKGROUND

The use of electronic devices for making payments at point-of-saleterminals and over the Internet has increased significantly in recentyears. Exemplary point-of-sale terminals include Near FieldCommunication-enabled (NFC-enabled) terminals, bluetooth-enabledterminals, and barcode scanner-enabled terminals. Electronic devices canbe used in conjunction with these exemplary terminals to enable the userof the electronic device to make a payment for the purchase of, forexample, a good or service. Similarly, electronic devices can be used inconjunction with Internet shopping carts to enable the user to make apayment by entering their credit card information.

SUMMARY

Some techniques for making payments using electronic devices, however,are generally cumbersome and inefficient. For example, making a purchaseusing an NFC-enabled device at a point-of-sale terminal frequentlyrequires navigating a complex and time-consuming user interface. Foranother example, a user wanting to make a purchase through a website ormobile application of a retailer may need to manually enter a creditcard number and shipping address information for making the purchase, aninefficient and cumbersome procedure. For another example, making apurchase using an NFC-enabled device at a point-of-sale terminalfrequently requires navigating a complex and time-consuming userinterface to select the payment account that should be charged. Foranother example, users who purchase a real-world good or service arefrequently not notified of a digital item and/or do not have convenientaccess to a digital item, such as software, that corresponds to thepurchased item. For another example, making a payment requiresnavigating a complex and time-consuming user interface to select therecipients of the payment. For another example, navigating a userinterface to make a purchase from a retailer is using the retailer'sapplication is inefficient. For another example, accessing variousapplications and navigating their complex user interface to make arepeat or related purchase of a product is inefficient. In addition,existing techniques take longer than necessary, thereby wasting energy.This latter consideration is particularly important in battery-operateddevices.

Accordingly, there is a need for electronic devices with faster, moreefficient methods and interfaces for making payment transactions. Suchmethods and interfaces optionally complement or replace conventionalmethods for making payments. Such methods and interfaces reduce thecognitive burden on a user and produce a more efficient human-machineinterface. For battery-operated computing devices, such methods andinterfaces conserve power and increase the time between battery charges.

The above deficiencies and other problems associated with userinterfaces for computing devices for making payment transactions arereduced or eliminated by the disclosed devices. In some embodiments, thedevice is a desktop computer. In some embodiments, the device isportable (e.g., a notebook computer, tablet computer, or handhelddevice). In some embodiments, the device has a touchpad. In someembodiments, the device has a touch-sensitive display (also known as a“touch screen” or “touch screen display”). In some embodiments, thedevice has a short-range communication radio. In some embodiments, thedevice has a graphical user interface (GUI), one or more processors,memory and one or more modules, programs or sets of instructions storedin the memory for performing multiple functions. In some embodiments,the user interacts with the GUI primarily through finger contacts andgestures on the touch-sensitive surface. Executable instructions forperforming functions may be included in a computer readable storagemedium or other computer program product configured for execution by oneor more processors.

In accordance with some embodiments, a method is performed at anelectronic device with a display. The method includes receiving arequest to link a payment account associated with a credit card to arespective device, wherein the request includes information about thecredit card. The method includes, in response to receiving the request,determining whether further verification is needed to link the paymentaccount to the respective device. The method includes, in accordancewith a determination that further verification is not needed to link thepayment account to the respective device, linking the payment account tothe respective device and providing an indication that the paymentaccount has been linked to the respective device. The method alsoincludes, in accordance with a determination that further verificationis needed to link the payment account to the respective device,providing an indication that further verification is needed to link thepayment account to the respective device.

In accordance with some embodiments, a method is performed at anelectronic device with a display and a short-range communication radio.The method includes detecting, by the short-range communication radio,presence of a field generated by a contactless payment transactionterminal. The method includes, in response to detecting presence of thefield generated by the contactless payment transaction terminal,determining whether authorization to proceed with a payment transactionis provided. The method includes, in accordance with a determinationthat authorization to proceed with the payment transaction has beenprovided, proceeding with the payment transaction with the contactlesspayment transaction terminal. The method also includes, in accordancewith a determination that authorization to proceed with the paymenttransaction has not been provided, providing an indication requestingauthorization to proceed with the payment transaction.

In accordance with some embodiments, a method is performed at anelectronic device with a display. The method includes displaying, on thedisplay, an electronic wallet comprising a respective representation ofa payment account, wherein the respective representation of the paymentaccount includes first transaction information for a first paymenttransaction associated with the payment account. The method includesdetecting a second payment transaction associated with the paymentaccount using the electronic device. The method also includes, inresponse to detecting the second payment transaction, and prior toreceiving information about the second payment transaction from thefinancial institution involved in the second transaction, displayingsecond transaction information for the second payment transaction, thesecond transaction information based on information locally available tothe electronic device.

In accordance with some embodiments, a method is performed at anelectronic device with a display. The method includes displaying, on thedisplay, a user interface for a first application, wherein the userinterface for the first application includes a payment affordanceassociated with a payment transaction. The method includes detectingselection of the payment affordance. The method also includes, inresponse to detecting selection of the payment affordance, transferringfirst transaction information about the payment transaction from thefirst application to a second application; and displaying, on thedisplay, a user interface for the second application, wherein the userinterface for the second application includes the first transactioninformation received from the first application and includes secondtransaction information provided by the second application, wherein thesecond transaction information is not available to the firstapplication.

In accordance with some embodiments, a method is performed at anelectronic device with a processor and memory. The method includes:linking a plurality of payment accounts to the electronic device,wherein the plurality of payment accounts include a first paymentaccount and a second payment account that is different from the firstpayment account; receiving a payment transaction request of a paymenttransaction, wherein the first payment account and the second paymentaccount are both available to provide payment for the paymenttransaction; in response to receiving the payment transaction request:obtaining payment account selection information; in accordance with adetermination, based on the payment account selection information, thatfirst payment transaction criteria are met, providing payment in thepayment transaction using the first payment account; and in accordancewith a determination, based on the payment account selectioninformation, that second payment transaction criteria are met, providingpayment in the payment transaction using the second payment account.

In accordance with some embodiments, a method is performed at anelectronic device with a display, a processor, and memory. The methodincludes: authorizing a payment transaction for a purchased item using apayment account linked to the electronic device, wherein the purchaseditem is selected from the set comprising: a physical good and areal-world service; and after authorizing the payment transaction:determining that the purchased item is associated with a digital item,wherein the digital item is different from the purchased item; anddisplaying, on a display of the device, an indication of the digitalitem that is associated with the purchased item.

In accordance with some embodiments, a method is performed at anelectronic device with a display, a processor, and memory. The methodincludes: displaying a user interface for a communication applicationthat includes a user interface indicative of ongoing communicationbetween a user of the device and one or more other participants, whereinthe user interface for the communication application includes a paymentaffordance; while displaying the user interface indicative of theongoing communication, detecting activation of the payment affordance;and in response to detecting activation of the payment affordance,initiating a payment transaction between the user and the one or moreother participants in the ongoing communication.

In accordance with some embodiments, a method is performed at anelectronic device with a display, a processor, and memory. The methodincludes: displaying a user interface for a first application, whereinthe user interface for the first application includes informationidentifying a plurality of retailers; receiving a request to initiate apayment transaction with a first retailer of the plurality of retailers;in response to receiving the request to initiate a payment transactionwith the first retailer: in accordance with a determination that anapplication of the first retailer is available on the device, invokingthe application of the first retailer, wherein the application of thefirst retailer enables the user to initiate a payment transaction withthe first retailer; and in accordance with a determination that anapplication of the first retailer is not available on the device,providing the user with an option for proceeding with the paymenttransaction without invoking the application of the first retailer.

In accordance with some embodiments, a method is performed at anelectronic device with a display, a processor, and memory. The methodincludes: obtaining a history of payment transactions associated withone or more payment accounts linked to the device; determining a currentlocation of the device; determining, based on at least a portion of thehistory of payment transactions and the current location of the device,a suggested product for purchase from a retailer; displaying anindication of the suggested product for purchase; displaying anaffordance associated with a payment transaction of the suggestedproduct; while displaying the affordance associated with the paymenttransaction, detecting activation of the affordance associated with thepayment transaction; and in response to detecting activation of theaffordance associated with the payment transaction, initiating a processfor authorizing the payment transaction of the suggested product.

Thus, multifunction devices are provided with faster, more efficientmethods and interfaces for handling payment transactions, therebyincreasing the effectiveness, efficiency, and user satisfaction withsuch devices. Such methods and interfaces may complement or replaceconventional methods for handling payment transactions.

BRIEF DESCRIPTION OF THE DRAWINGS

For a better understanding of the aforementioned embodiments of theinvention as well as additional embodiments thereof, reference should bemade to the Description of Embodiments below, in conjunction with thefollowing drawings in which like reference numerals refer tocorresponding parts throughout the figures.

FIG. 1A is a block diagram illustrating a portable multifunction devicewith a display in accordance with some embodiments.

FIG. 1B is a block diagram illustrating exemplary components for eventhandling in accordance with some embodiments.

FIG. 2 illustrates a portable multifunction device having a touch screenin accordance with some embodiments.

FIG. 3 is a block diagram of an exemplary multifunction device with adisplay in accordance with some embodiments.

FIG. 4A illustrates an exemplary user interface for a menu ofapplications on a portable multifunction device in accordance with someembodiments.

FIG. 4B illustrates an exemplary user interface for a multifunctiondevice with a touch-sensitive surface that is separate from the displayin accordance with some embodiments.

FIGS. 5A-5I illustrate exemplary user interfaces for linking a paymentaccount to a respective device in accordance with some embodiments.

FIGS. 6A-6C are flow diagrams illustrating a method for linking apayment account to a respective device in accordance with someembodiments.

FIGS. 7A-7O illustrate exemplary user interfaces for proceeding with apayment transaction using a short-range communication radio inaccordance with some embodiments.

FIGS. 8A-8B are flow diagrams illustrating a method for proceeding witha payment transaction using a short-range communication radio inaccordance with some embodiments.

FIGS. 9A-9H illustrate exemplary user interfaces for displayingtransaction information of a payment account in accordance with someembodiments.

FIGS. 10A-10B are flow diagrams illustrating a method for displayingtransaction information of a payment account in accordance with someembodiments.

FIGS. 11A-11N illustrate exemplary user interfaces for making a paymenttransaction in accordance with some embodiments.

FIGS. 12A-12C are flow diagrams illustrating a method for making apayment transaction in accordance with some embodiments.

FIGS. 13A-13D illustrate exemplary user interfaces for selecting apayment account from among available payment accounts in accordance withsome embodiments.

FIG. 14 is a flow diagram illustrating a method for selecting a paymentaccount from among available payment accounts in accordance with someembodiments.

FIG. 15 illustrates an exemplary user interface for displaying anindication of a digital item associated with a purchased item inaccordance with some embodiments.

FIG. 16 is a flow diagram illustrating a method for displaying anindication of a digital item associated with a purchased item inaccordance with some embodiments.

FIGS. 17A-17B illustrate exemplary user interfaces for initiating apayment transaction with participants of an ongoing communication inaccordance with some embodiments.

FIG. 18 is a flow diagram illustrating a method for initiating a paymenttransaction with participants of an ongoing communication in accordancewith some embodiments.

FIG. 19 illustrates an exemplary user interface for invoking anapplication of a retailer based on the availability of the applicationin accordance with some embodiments.

FIG. 20 is a flow diagram illustrating a method for invoking anapplication of a retailer based on the availability of the applicationin accordance with some embodiments.

FIG. 21 illustrates an exemplary user interface for providing a purchaserecommendation in accordance with some embodiments.

FIG. 22 is a flow diagram illustrating a method for providing a purchaserecommendation in accordance with some embodiments.

FIG. 23 illustrates a functional block diagram in accordance with someembodiments.

DESCRIPTION OF EMBODIMENTS

Below, FIGS. 1A-1B, 2, 3, and 4A-4B, and 23 provide a description ofexemplary devices for performing techniques related to payments. FIGS.5, 7, 9, 11, 13, 15, 17, 19, and 21 illustrate exemplary user interfacesfor payments. The user interfaces in the figures are also used toillustrate the processes described below, including the processes inFIGS. 6, 8, 10, 12, 14, 16, 18, 20, and 22.

Although the following description uses terms “first,” “second,” etc. todescribe various elements, these elements should not be limited by theterms. These terms are only used to distinguish one element fromanother. For example, a first touch could be termed a second touch, and,similarly, a second touch could be termed a first touch, withoutdeparting from the scope of the various described embodiments. The firsttouch and the second touch are both touches, but they are not the sametouch.

The terminology used in the description of the various describedembodiments herein is for the purpose of describing particularembodiments only and is not intended to be limiting. As used in thedescription of the various described embodiments and the appendedclaims, the singular forms “a”, “an,” and “the” are intended to includethe plural forms as well, unless the context clearly indicatesotherwise. It will also be understood that the term “and/or” as usedherein refers to and encompasses any and all possible combinations ofone or more of the associated listed items. It will be furtherunderstood that the terms “includes,” “including,” “comprises,” and/or“comprising,” when used in this specification, specify the presence ofstated features, integers, steps, operations, elements, and/orcomponents, but do not preclude the presence or addition of one or moreother features, integers, steps, operations, elements, components,and/or groups thereof.

The term “if” may be construed to mean “when” or “upon” or “in responseto determining” or “in response to detecting,” depending on the context.Similarly, the phrase “if it is determined” or “if [a stated conditionor event] is detected” may be construed to mean “upon determining” or“in response to determining” or “upon detecting [the stated condition orevent]” or “in response to detecting [the stated condition or event],”depending on the context.

Embodiments of electronic devices, user interfaces for such devices, andassociated processes for using such devices are described. In someembodiments, the device is a portable communications device, such as amobile telephone, that also contains other functions, such as PDA and/ormusic player functions. Exemplary embodiments of portable multifunctiondevices include, without limitation, the iPhone®, iPod Touch®, and iPad®devices from Apple Inc. of Cupertino, Calif. Other portable electronicdevices, such as laptops or tablet computers with touch-sensitivesurfaces (e.g., touch screen displays and/or touchpads), are,optionally, used. It should also be understood that, in someembodiments, the device is not a portable communications device, but isa desktop computer with a touch-sensitive surface (e.g., a touch screendisplay and/or a touchpad).

In the discussion that follows, an electronic device that includes adisplay and a touch-sensitive surface is described. It should beunderstood, however, that the electronic device optionally includes oneor more other physical user-interface devices, such as a physicalkeyboard, a mouse, and/or a joystick.

The device may support a variety of applications, such as one or more ofthe following: a drawing application, a presentation application, a wordprocessing application, a website creation application, a disk authoringapplication, a spreadsheet application, a gaming application, atelephone application, a video conferencing application, an e-mailapplication, an instant messaging application, a workout supportapplication, a photo management application, a digital cameraapplication, a digital video camera application, a web browsingapplication, a digital music player application, and/or a digital videoplayer application.

The various applications that are executed on the device optionally useat least one common physical user-interface device, such as thetouch-sensitive surface. One or more functions of the touch-sensitivesurface as well as corresponding information displayed on the deviceare, optionally, adjusted and/or varied from one application to the nextand/or within a respective application. In this way, a common physicalarchitecture (such as the touch-sensitive surface) of the deviceoptionally supports the variety of applications with user interfacesthat are intuitive and transparent to the user.

Attention is now directed toward embodiments of portable devices withtouch-sensitive displays. FIG. 1A is a block diagram illustratingportable multifunction device 100 with touch-sensitive display system112 in accordance with some embodiments. Touch-sensitive display 112 issometimes called a “touch screen” for convenience and is sometimes knownas or called a “touch-sensitive display system.” Device 100 includesmemory 102 (which optionally includes one or more computer-readablestorage mediums), memory controller 122, one or more processing units(CPUs) 120, peripherals interface 118, RF circuitry 108, audio circuitry110, speaker 111, microphone 113, input/output (I/O) subsystem 106,other input control devices 116, and external port 124. Device 100optionally includes one or more optical sensors 164. Device 100optionally includes one or more contact intensity sensors 165 fordetecting intensity of contacts on device 100 (e.g., a touch-sensitivesurface such as touch-sensitive display system 112 of device 100).Device 100 optionally includes one or more tactile output generators 167for generating tactile outputs on device 100 (e.g., generating tactileoutputs on a touch-sensitive surface such as touch-sensitive displaysystem 112 of device 100 or touchpad 355 of device 300). Thesecomponents optionally communicate over one or more communication busesor signal lines 103.

As used in the specification and claims, the term “intensity” of acontact on a touch-sensitive surface refers to the force or pressure(force per unit area) of a contact (e.g., a finger contact) on thetouch-sensitive surface, or to a substitute (proxy) for the force orpressure of a contact on the touch-sensitive surface. The intensity of acontact has a range of values that includes at least four distinctvalues and more typically includes hundreds of distinct values (e.g., atleast 256). Intensity of a contact is, optionally, determined (ormeasured) using various approaches and various sensors or combinationsof sensors. For example, one or more force sensors underneath oradjacent to the touch-sensitive surface are, optionally, used to measureforce at various points on the touch-sensitive surface. In someimplementations, force measurements from multiple force sensors arecombined (e.g., a weighted average) to determine an estimated force of acontact. Similarly, a pressure-sensitive tip of a stylus is, optionally,used to determine a pressure of the stylus on the touch-sensitivesurface. Alternatively, the size of the contact area detected on thetouch-sensitive surface and/or changes thereto, the capacitance of thetouch-sensitive surface proximate to the contact and/or changes thereto,and/or the resistance of the touch-sensitive surface proximate to thecontact and/or changes thereto are, optionally, used as a substitute forthe force or pressure of the contact on the touch-sensitive surface. Insome implementations, the substitute measurements for contact force orpressure are used directly to determine whether an intensity thresholdhas been exceeded (e.g., the intensity threshold is described in unitscorresponding to the substitute measurements). In some implementations,the substitute measurements for contact force or pressure are convertedto an estimated force or pressure, and the estimated force or pressureis used to determine whether an intensity threshold has been exceeded(e.g., the intensity threshold is a pressure threshold measured in unitsof pressure). Using the intensity of a contact as an attribute of a userinput allows for user access to additional device functionality that mayotherwise not be accessible by the user on a reduced-size device withlimited real estate for displaying affordances (e.g., on atouch-sensitive display) and/or receiving user input (e.g., via atouch-sensitive display, a touch-sensitive surface, or aphysical/mechanical control such as a knob or a button).

As used in the specification and claims, the term “tactile output”refers to physical displacement of a device relative to a previousposition of the device, physical displacement of a component (e.g., atouch-sensitive surface) of a device relative to another component(e.g., housing) of the device, or displacement of the component relativeto a center of mass of the device that will be detected by a user withthe user's sense of touch. For example, in situations where the deviceor the component of the device is in contact with a surface of a userthat is sensitive to touch (e.g., a finger, palm, or other part of auser's hand), the tactile output generated by the physical displacementwill be interpreted by the user as a tactile sensation corresponding toa perceived change in physical characteristics of the device or thecomponent of the device. For example, movement of a touch-sensitivesurface (e.g., a touch-sensitive display or trackpad) is, optionally,interpreted by the user as a “down click” or “up click” of a physicalactuator button. In some cases, a user will feel a tactile sensationsuch as an “down click” or “up click” even when there is no movement ofa physical actuator button associated with the touch-sensitive surfacethat is physically pressed (e.g., displaced) by the user's movements. Asanother example, movement of the touch-sensitive surface is, optionally,interpreted or sensed by the user as “roughness” of the touch-sensitivesurface, even when there is no change in smoothness of thetouch-sensitive surface. While such interpretations of touch by a userwill be subject to the individualized sensory perceptions of the user,there are many sensory perceptions of touch that are common to a largemajority of users. Thus, when a tactile output is described ascorresponding to a particular sensory perception of a user (e.g., an “upclick,” a “down click,” “roughness”), unless otherwise stated, thegenerated tactile output corresponds to physical displacement of thedevice or a component thereof that will generate the described sensoryperception for a typical (or average) user.

It should be appreciated that device 100 is only one example of aportable multifunction device, and that device 100 optionally has moreor fewer components than shown, optionally combines two or morecomponents, or optionally has a different configuration or arrangementof the components. The various components shown in FIG. 1A areimplemented in hardware, software, or a combination of both hardware andsoftware, including one or more signal processing and/orapplication-specific integrated circuits.

Memory 102 may include one or more computer-readable storage mediums.The computer-readable storage mediums may be tangible andnon-transitory. Memory 102 may include high-speed random access memoryand may also include non-volatile memory, such as one or more magneticdisk storage devices, flash memory devices, or other non-volatilesolid-state memory devices. Memory controller 122 may control access tomemory 102 by other components of device 100.

Peripherals interface 118 can be used to couple input and outputperipherals of the device to CPU 120 and memory 102. The one or moreprocessors 120 run or execute various software programs and/or sets ofinstructions stored in memory 102 to perform various functions fordevice 100 and to process data. In some embodiments, peripheralsinterface 118, CPU 120, and memory controller 122 may be implemented ona single chip, such as chip 104. In some other embodiments, they may beimplemented on separate chips.

RF (radio frequency) circuitry 108 receives and sends RF signals, alsocalled electromagnetic signals. RF circuitry 108 converts electricalsignals to/from electromagnetic signals and communicates withcommunications networks and other communications devices via theelectromagnetic signals. RF circuitry 108 optionally includes well-knowncircuitry for performing these functions, including but not limited toan antenna system, an RF transceiver, one or more amplifiers, a tuner,one or more oscillators, a digital signal processor, a CODEC chipset, asubscriber identity module (SIM) card, memory, and so forth. RFcircuitry 108 optionally communicates with networks, such as theInternet, also referred to as the World Wide Web (WWW), an intranetand/or a wireless network, such as a cellular telephone network, awireless local area network (LAN) and/or a metropolitan area network(MAN), and other devices by wireless communication. The RF circuitry 108optionally includes well-known circuitry for detecting near fieldcommunication (NFC) fields, such as by a short-range communicationradio. The wireless communication optionally uses any of a plurality ofcommunications standards, protocols, and technologies, including but notlimited to Global System for Mobile Communications (GSM), Enhanced DataGSM Environment (EDGE), high-speed downlink packet access (HSDPA),high-speed uplink packet access (HSUPA), Evolution, Data-Only (EV-DO),HSPA, HSPA+, Dual-Cell HSPA (DC-HSPDA), long term evolution (LTE), nearfield communication (NFC), wideband code division multiple access(W-CDMA), code division multiple access (CDMA), time division multipleaccess (TDMA), Bluetooth, Bluetooth Low Energy (BTLE), Wireless Fidelity(Wi-Fi) (e.g., IEEE 802.11a, IEEE 802.11b, IEEE 802.11g, IEEE 802.11n,and/or IEEE 802.11ac), voice over Internet Protocol (VoIP), Wi-MAX, aprotocol for e-mail (e.g., Internet message access protocol (IMAP)and/or post office protocol (POP)), instant messaging (e.g., extensiblemessaging and presence protocol (XMPP), Session Initiation Protocol forInstant Messaging and Presence Leveraging Extensions (SIMPLE), InstantMessaging and Presence Service (IMPS)), and/or Short Message Service(SMS), or any other suitable communication protocol, includingcommunication protocols not yet developed as of the filing date of thisdocument.

Audio circuitry 110, speaker 111, and microphone 113 provide an audiointerface between a user and device 100. Audio circuitry 110 receivesaudio data from peripherals interface 118, converts the audio data to anelectrical signal, and transmits the electrical signal to speaker 111.Speaker 111 converts the electrical signal to human-audible sound waves.Audio circuitry 110 also receives electrical signals converted bymicrophone 113 from sound waves. Audio circuitry 110 converts theelectrical signal to audio data and transmits the audio data toperipherals interface 118 for processing. Audio data may be retrievedfrom and/or transmitted to memory 102 and/or RF circuitry 108 byperipherals interface 118. In some embodiments, audio circuitry 110 alsoincludes a headset jack (e.g., 212, FIG. 2). The headset jack providesan interface between audio circuitry 110 and removable audioinput/output peripherals, such as output-only headphones or a headsetwith both output (e.g., a headphone for one or both ears) and input(e.g., a microphone).

I/O subsystem 106 couples input/output peripherals on device 100, suchas touch screen 112 and other input control devices 116, to peripheralsinterface 118. I/O subsystem 106 optionally includes display controller156, optical sensor controller 158, intensity sensor controller 159,haptic feedback controller 161, and one or more input controllers 160for other input or control devices. The one or more input controllers160 receive/send electrical signals from/to other input control devices116. The other input control devices 116 optionally include physicalbuttons (e.g., push buttons, rocker buttons, etc.), dials, sliderswitches, joysticks, click wheels, and so forth. In some alternateembodiments, input controller(s) 160 are, optionally, coupled to any (ornone) of the following: a keyboard, an infrared port, a USB port, and apointer device such as a mouse. The one or more buttons (e.g., 208, FIG.2) optionally include an up/down button for volume control of speaker111 and/or microphone 113. The one or more buttons optionally include apush button (e.g., 206, FIG. 2).

A quick press of the push button may disengage a lock of touch screen112 or begin a process that uses gestures on the touch screen to unlockthe device, as described in U.S. patent application Ser. No. 11/322,549,“Unlocking a Device by Performing Gestures on an Unlock Image,” filedDec. 23, 2005, U.S. Pat. No. 7,657,849, which is hereby incorporated byreference in its entirety. A longer press of the push button (e.g., 206)may turn power to device 100 on or off. The user may be able tocustomize a functionality of one or more of the buttons. Touch screen112 is used to implement virtual or soft buttons and one or more softkeyboards.

Touch-sensitive display 112 provides an input interface and an outputinterface between the device and a user. Display controller 156 receivesand/or sends electrical signals from/to touch screen 112. Touch screen112 displays visual output to the user. The visual output may includegraphics, text, icons, video, and any combination thereof (collectivelytermed “graphics”). In some embodiments, some or all of the visualoutput may correspond to user-interface objects.

Touch screen 112 has a touch-sensitive surface, sensor, or set ofsensors that accepts input from the user based on haptic and/or tactilecontact. Touch screen 112 and display controller 156 (along with anyassociated modules and/or sets of instructions in memory 102) detectcontact (and any movement or breaking of the contact) on touch screen112 and convert the detected contact into interaction withuser-interface objects (e.g., one or more soft keys, icons, web pages,or images) that are displayed on touch screen 112. In an exemplaryembodiment, a point of contact between touch screen 112 and the usercorresponds to a finger of the user.

Touch screen 112 may use LCD (liquid crystal display) technology, LPD(light emitting polymer display) technology, or LED (light emittingdiode) technology, although other display technologies may be used inother embodiments. Touch screen 112 and display controller 156 maydetect contact and any movement or breaking thereof using any of aplurality of touch sensing technologies now known or later developed,including but not limited to capacitive, resistive, infrared, andsurface acoustic wave technologies, as well as other proximity sensorarrays or other elements for determining one or more points of contactwith touch screen 112. In an exemplary embodiment, projected mutualcapacitance sensing technology is used, such as that found in theiPhone® and iPod Touch® from Apple Inc. of Cupertino, Calif.

A touch-sensitive display in some embodiments of touch screen 112 may beanalogous to the multi-touch sensitive touchpads described in thefollowing U.S. Pat. No. 6,323,846 (Westerman et al.), U.S. Pat. No.6,570,557 (Westerman et al.), and/or U.S. Pat. No. 6,677,932(Westerman), and/or U.S. Patent Publication 2002/0015024A1, each ofwhich is hereby incorporated by reference in its entirety. However,touch screen 112 displays visual output from device 100, whereastouch-sensitive touchpads do not provide visual output.

A touch-sensitive display in some embodiments of touch screen 112 may beas described in the following applications: (1) U.S. patent applicationSer. No. 11/381,313, “Multipoint Touch Surface Controller,” filed May 2,2006; (2) U.S. patent application Ser. No. 10/840,862, “MultipointTouchscreen,” filed May 6, 2004; (3) U.S. patent application Ser. No.10/903,964, “Gestures For Touch Sensitive Input Devices,” filed Jul. 30,2004; (4) U.S. patent application Ser. No. 11/048,264, “Gestures ForTouch Sensitive Input Devices,” filed Jan. 31, 2005; (5) U.S. patentapplication Ser. No. 11/038,590, “Mode-Based Graphical User InterfacesFor Touch Sensitive Input Devices,” filed Jan. 18, 2005; (6) U.S. patentapplication Ser. No. 11/228,758, “Virtual Input Device Placement On ATouch Screen User Interface,” filed Sep. 16, 2005; (7) U.S. patentapplication Ser. No. 11/228,700, “Operation Of A Computer With A TouchScreen Interface,” filed Sep. 16, 2005; (8) U.S. patent application Ser.No. 11/228,737, “Activating Virtual Keys Of A Touch-Screen VirtualKeyboard,” filed Sep. 16, 2005; and (9) U.S. patent application Ser. No.11/367,749, “Multi-Functional Hand-Held Device,” filed Mar. 3, 2006. Allof these applications are incorporated by reference herein in theirentirety.

Touch screen 112 may have a video resolution in excess of 100 dpi. Insome embodiments, the touch screen has a video resolution ofapproximately 160 dpi. The user may make contact with touch screen 112using any suitable object or appendage, such as a stylus, a finger, andso forth. In some embodiments, the user interface is designed to workprimarily with finger-based contacts and gestures, which can be lessprecise than stylus-based input due to the larger area of contact of afinger on the touch screen. In some embodiments, the device translatesthe rough finger-based input into a precise pointer/cursor position orcommand for performing the actions desired by the user.

In some embodiments, in addition to the touch screen, device 100 mayinclude a touchpad (not shown) for activating or deactivating particularfunctions. In some embodiments, the touchpad is a touch-sensitive areaof the device that, unlike the touch screen, does not display visualoutput. The touchpad may be a touch-sensitive surface that is separatefrom touch screen 112 or an extension of the touch-sensitive surfaceformed by the touch screen.

Device 100 also includes power system 162 for powering the variouscomponents. Power system 162 may include a power management system, oneor more power sources (e.g., battery, alternating current (AC)), arecharging system, a power failure detection circuit, a power converteror inverter, a power status indicator (e.g., a light-emitting diode(LED)) and any other components associated with the generation,management and distribution of power in portable devices.

Device 100 may also include one or more optical sensors 164. FIG. 1Ashows an optical sensor coupled to optical sensor controller 158 in I/Osubsystem 106. Optical sensor 164 may include charge-coupled device(CCD) or complementary metal-oxide semiconductor (CMOS)phototransistors. Optical sensor 164 receives light from theenvironment, projected through one or more lenses, and converts thelight to data representing an image. In conjunction with imaging module143 (also called a camera module), optical sensor 164 may capture stillimages or video. In some embodiments, an optical sensor is located onthe back of device 100, opposite touch screen display 112 on the frontof the device so that the touch screen display may be used as aviewfinder for still and/or video image acquisition. In someembodiments, an optical sensor is located on the front of the device sothat the user's image may be obtained for video conferencing while theuser views the other video conference participants on the touch screendisplay. In some embodiments, the position of optical sensor 164 can bechanged by the user (e.g., by rotating the lens and the sensor in thedevice housing) so that a single optical sensor 164 may be used alongwith the touch screen display for both video conferencing and stilland/or video image acquisition.

Device 100 optionally also includes one or more contact intensitysensors 165. FIG. 1A shows a contact intensity sensor coupled tointensity sensor controller 159 in I/O subsystem 106. Contact intensitysensor 165 optionally includes one or more piezoresistive strain gauges,capacitive force sensors, electric force sensors, piezoelectric forcesensors, optical force sensors, capacitive touch-sensitive surfaces, orother intensity sensors (e.g., sensors used to measure the force (orpressure) of a contact on a touch-sensitive surface). Contact intensitysensor 165 receives contact intensity information (e.g., pressureinformation or a proxy for pressure information) from the environment.In some embodiments, at least one contact intensity sensor is collocatedwith, or proximate to, a touch-sensitive surface (e.g., touch-sensitivedisplay system 112). In some embodiments, at least one contact intensitysensor is located on the back of device 100, opposite touch screendisplay 112, which is located on the front of device 100.

Device 100 may also include one or more proximity sensors 166. FIG. 1Ashows proximity sensor 166 coupled to peripherals interface 118.Alternately, proximity sensor 166 may be coupled to input controller 160in I/O subsystem 106. Proximity sensor 166 may perform as described inU.S. patent application Ser. No. 11/241,839, “Proximity Detector InHandheld Device”; Ser. No. 11/240,788, “Proximity Detector In HandheldDevice”; Ser. No. 11/620,702, “Using Ambient Light Sensor To AugmentProximity Sensor Output”; Ser. No. 11/586,862, “Automated Response ToAnd Sensing Of User Activity In Portable Devices”; and Ser. No.11/638,251, “Methods And Systems For Automatic Configuration OfPeripherals,” which are hereby incorporated by reference in theirentirety. In some embodiments, the proximity sensor turns off anddisables touch screen 112 when the multifunction device is placed nearthe user's ear (e.g., when the user is making a phone call).

Device 100 optionally also includes one or more tactile outputgenerators 167. FIG. 1A shows a tactile output generator coupled tohaptic feedback controller 161 in I/O subsystem 106. Tactile outputgenerator 167 optionally includes one or more electroacoustic devicessuch as speakers or other audio components and/or electromechanicaldevices that convert energy into linear motion such as a motor,solenoid, electroactive polymer, piezoelectric actuator, electrostaticactuator, or other tactile output generating component (e.g., acomponent that converts electrical signals into tactile outputs on thedevice). Contact intensity sensor 165 receives tactile feedbackgeneration instructions from haptic feedback module 133 and generatestactile outputs on device 100 that are capable of being sensed by a userof device 100. In some embodiments, at least one tactile outputgenerator is collocated with, or proximate to, a touch-sensitive surface(e.g., touch-sensitive display system 112) and, optionally, generates atactile output by moving the touch-sensitive surface vertically (e.g.,in/out of a surface of device 100) or laterally (e.g., back and forth inthe same plane as a surface of device 100). In some embodiments, atleast one tactile output generator sensor is located on the back ofdevice 100, opposite touch screen display 112, which is located on thefront of device 100.

Device 100 may also include one or more accelerometers 168. FIG. 1Ashows accelerometer 168 coupled to peripherals interface 118.Alternately, accelerometer 168 may be coupled to an input controller 160in I/O subsystem 106. Accelerometer 168 may perform as described in U.S.Patent Publication No. 20050190059, “Acceleration-based Theft DetectionSystem for Portable Electronic Devices,” and U.S. Patent Publication No.20060017692, “Methods And Apparatuses For Operating A Portable DeviceBased On An Accelerometer,” both of which are incorporated by referenceherein in their entirety. In some embodiments, information is displayedon the touch screen display in a portrait view or a landscape view basedon an analysis of data received from the one or more accelerometers.Device 100 optionally includes, in addition to accelerometer(s) 168, amagnetometer (not shown) and a GPS (or GLONASS or other globalnavigation system) receiver (not shown) for obtaining informationconcerning the location and orientation (e.g., portrait or landscape) ofdevice 100.

In some embodiments, the software components stored in memory 102include operating system 126, communication module (or set ofinstructions) 128, contact/motion module (or set of instructions) 130,graphics module (or set of instructions) 132, text input module (or setof instructions) 134, Global Positioning System (GPS) module (or set ofinstructions) 135, and applications (or sets of instructions) 136.Furthermore, in some embodiments, memory 102 (FIG. 1A) or 370 (FIG. 3)stores device/global internal state 157, as shown in FIGS. 1A and 3.Device/global internal state 157 includes one or more of: activeapplication state, indicating which applications, if any, are currentlyactive; display state, indicating what applications, views or otherinformation occupy various regions of touch screen display 112; sensorstate, including information obtained from the device's various sensorsand input control devices 116; and location information concerning thedevice's location and/or attitude.

Operating system 126 (e.g., Darwin, RTXC, LINUX, UNIX, OS X, iOS,WINDOWS, or an embedded operating system such as VxWorks) includesvarious software components and/or drivers for controlling and managinggeneral system tasks (e.g., memory management, storage device control,power management, etc.) and facilitates communication between varioushardware and software components.

Communication module 128 facilitates communication with other devicesover one or more external ports 124 and also includes various softwarecomponents for handling data received by RF circuitry 108 and/orexternal port 124. External port 124 (e.g., Universal Serial Bus (USB),FIREWIRE, etc.) is adapted for coupling directly to other devices orindirectly over a network (e.g., the Internet, wireless LAN, etc.). Insome embodiments, the external port is a multi-pin (e.g., 30-pin)connector that is the same as, or similar to and/or compatible with, the30-pin connector used on iPod® (trademark of Apple Inc.) devices.

Contact/motion module 130 optionally detects contact with touch screen112 (in conjunction with display controller 156) and othertouch-sensitive devices (e.g., a touchpad or physical click wheel).Contact/motion module 130 includes various software components forperforming various operations related to detection of contact, such asdetermining if contact has occurred (e.g., detecting a finger-downevent), determining an intensity of the contact (e.g., the force orpressure of the contact or a substitute for the force or pressure of thecontact), determining if there is movement of the contact and trackingthe movement across the touch-sensitive surface (e.g., detecting one ormore finger-dragging events), and determining if the contact has ceased(e.g., detecting a finger-up event or a break in contact).Contact/motion module 130 receives contact data from the touch-sensitivesurface. Determining movement of the point of contact, which isrepresented by a series of contact data, optionally includes determiningspeed (magnitude), velocity (magnitude and direction), and/or anacceleration (a change in magnitude and/or direction) of the point ofcontact. These operations are, optionally, applied to single contacts(e.g., one finger contacts) or to multiple simultaneous contacts (e.g.,“multitouch”/multiple finger contacts). In some embodiments,contact/motion module 130 and display controller 156 detect contact on atouchpad.

In some embodiments, contact/motion module 130 uses a set of one or moreintensity thresholds to determine whether an operation has beenperformed by a user (e.g., to determine whether a user has “clicked” onan icon). In some embodiments, at least a subset of the intensitythresholds are determined in accordance with software parameters (e.g.,the intensity thresholds are not determined by the activation thresholdsof particular physical actuators and can be adjusted without changingthe physical hardware of device 100). For example, a mouse “click”threshold of a trackpad or touch screen display can be set to any of alarge range of predefined threshold values without changing the trackpador touch screen display hardware. Additionally, in some implementations,a user of the device is provided with software settings for adjustingone or more of the set of intensity thresholds (e.g., by adjustingindividual intensity thresholds and/or by adjusting a plurality ofintensity thresholds at once with a system-level click “intensity”parameter).

Contact/motion module 130 optionally detects a gesture input by a user.Different gestures on the touch-sensitive surface have different contactpatterns (e.g., different motions, timings, and/or intensities ofdetected contacts). Thus, a gesture is, optionally, detected bydetecting a particular contact pattern. For example, detecting a fingertap gesture includes detecting a finger-down event followed by detectinga finger-up (liftoff) event at the same position (or substantially thesame position) as the finger-down event (e.g., at the position of anicon). As another example, detecting a finger swipe gesture on thetouch-sensitive surface includes detecting a finger-down event followedby detecting one or more finger-dragging events, and subsequentlyfollowed by detecting a finger-up (liftoff) event.

Graphics module 132 includes various known software components forrendering and displaying graphics on touch screen 112 or other display,including components for changing the visual impact (e.g., brightness,transparency, saturation, contrast, or other visual property) ofgraphics that are displayed. As used herein, the term “graphics”includes any object that can be displayed to a user, including, withoutlimitation, text, web pages, icons (such as user-interface objectsincluding soft keys), digital images, videos, animations, and the like.

In some embodiments, graphics module 132 stores data representinggraphics to be used. Each graphic is, optionally, assigned acorresponding code. Graphics module 132 receives, from applicationsetc., one or more codes specifying graphics to be displayed along with,if necessary, coordinate data and other graphic property data, and thengenerates screen image data to output to display controller 156.

Haptic feedback module 133 includes various software components forgenerating instructions used by tactile output generator(s) 167 toproduce tactile outputs at one or more locations on device 100 inresponse to user interactions with device 100.

Text input module 134, which may be a component of graphics module 132,provides soft keyboards for entering text in various applications (e.g.,contacts 137, e-mail 140, IM 141, browser 147, and any other applicationthat needs text input).

GPS module 135 determines the location of the device and provides thisinformation for use in various applications (e.g., to telephone 138 foruse in location-based dialing; to camera 143 as picture/video metadata;and to applications that provide location-based services such as weatherwidgets, local yellow page widgets, and map/navigation widgets).

Applications 136 may include the following modules (or sets ofinstructions), or a subset or superset thereof:

-   -   Contacts module 137 (sometimes called an address book or contact        list);    -   Telephone module 138;    -   Video conferencing module 139;    -   E-mail client module 140;    -   Instant messaging (IM) module 141;    -   Workout support module 142;    -   Camera module 143 for still and/or video images;    -   Image management module 144;    -   Video player module;    -   Music player module;    -   Browser module 147;    -   Calendar module 148;    -   Widget modules 149, which may include one or more of: weather        widget 149-1, stocks widget 149-2, calculator widget 149-3,        alarm clock widget 149-4, dictionary widget 149-5, and other        widgets obtained by the user, as well as user-created widgets        149-6;    -   Widget creator module 150 for making user-created widgets 149-6;    -   Search module 151;    -   Video and music player module 152, which merges video player        module and music player module;    -   Notes module 153;    -   Map module 154; and/or    -   Online video module 155.

Examples of other applications 136 that may be stored in memory 102include other word processing applications, other image editingapplications, drawing applications, presentation applications,JAVA-enabled applications, encryption, digital rights management, voicerecognition, and voice replication.

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, and text input module134, contacts module 137 may be used to manage an address book orcontact list (e.g., stored in application internal state 192 of contactsmodule 137 in memory 102 or memory 370), including: adding name(s) tothe address book; deleting name(s) from the address book; associatingtelephone number(s), e-mail address(es), physical address(es) or otherinformation with a name; associating an image with a name; categorizingand sorting names; providing telephone numbers or e-mail addresses toinitiate and/or facilitate communications by telephone 138, videoconference 139, e-mail 140, or IM 141; and so forth.

In conjunction with RF circuitry 108, audio circuitry 110, speaker 111,microphone 113, touch screen 112, display controller 156, contact/motionmodule 130, graphics module 132, and text input module 134, telephonemodule 138 may be used to enter a sequence of characters correspondingto a telephone number, access one or more telephone numbers in contactsmodule 137, modify a telephone number that has been entered, dial arespective telephone number, conduct a conversation, and disconnect orhang up when the conversation is completed. As noted above, the wirelesscommunication may use any of a plurality of communications standards,protocols, and technologies.

In conjunction with RF circuitry 108, audio circuitry 110, speaker 111,microphone 113, touch screen 112, display controller 156, optical sensor164, optical sensor controller 158, contact/motion module 130, graphicsmodule 132, text input module 134, contacts module 137, and telephonemodule 138, video conference module 139 includes executable instructionsto initiate, conduct, and terminate a video conference between a userand one or more other participants in accordance with user instructions.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, and textinput module 134, e-mail client module 140 includes executableinstructions to create, send, receive, and manage e-mail in response touser instructions. In conjunction with image management module 144,e-mail client module 140 makes it very easy to create and send e-mailswith still or video images taken with camera module 143.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, and textinput module 134, the instant messaging module 141 includes executableinstructions to enter a sequence of characters corresponding to aninstant message, to modify previously entered characters, to transmit arespective instant message (for example, using a Short Message Service(SMS) or Multimedia Message Service (MMS) protocol for telephony-basedinstant messages or using XMPP, SIMPLE, or IMPS for Internet-basedinstant messages), to receive instant messages, and to view receivedinstant messages. In some embodiments, transmitted and/or receivedinstant messages may include graphics, photos, audio files, video filesand/or other attachments as are supported in an MMS and/or an EnhancedMessaging Service (EMS). As used herein, “instant messaging” refers toboth telephony-based messages (e.g., messages sent using SMS or MMS) andInternet-based messages (e.g., messages sent using XMPP, SIMPLE, orIMPS).

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, GPS module 135, map module 154, and music playermodule, workout support module 142 includes executable instructions tocreate workouts (e.g., with time, distance, and/or calorie burninggoals); communicate with workout sensors (sports devices); receiveworkout sensor data; calibrate sensors used to monitor a workout; selectand play music for a workout; and display, store, and transmit workoutdata.

In conjunction with touch screen 112, display controller 156, opticalsensor(s) 164, optical sensor controller 158, contact/motion module 130,graphics module 132, and image management module 144, camera module 143includes executable instructions to capture still images or video(including a video stream) and store them into memory 102, modifycharacteristics of a still image or video, or delete a still image orvideo from memory 102.

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, text input module 134,and camera module 143, image management module 144 includes executableinstructions to arrange, modify (e.g., edit), or otherwise manipulate,label, delete, present (e.g., in a digital slide show or album), andstore still and/or video images.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, and textinput module 134, browser module 147 includes executable instructions tobrowse the Internet in accordance with user instructions, includingsearching, linking to, receiving, and displaying web pages or portionsthereof, as well as attachments and other files linked to web pages.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, e-mail client module 140, and browser module 147,calendar module 148 includes executable instructions to create, display,modify, and store calendars and data associated with calendars (e.g.,calendar entries, to-do lists, etc.) in accordance with userinstructions.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, and browser module 147, widget modules 149 aremini-applications that may be downloaded and used by a user (e.g.,weather widget 149-1, stocks widget 149-2, calculator widget 149-3,alarm clock widget 149-4, and dictionary widget 149-5) or created by theuser (e.g., user-created widget 149-6). In some embodiments, a widgetincludes an HTML (Hypertext Markup Language) file, a CSS (CascadingStyle Sheets) file, and a JavaScript file. In some embodiments, a widgetincludes an XML (Extensible Markup Language) file and a JavaScript file(e.g., Yahoo! Widgets).

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact/motion module 130, graphics module 132, textinput module 134, and browser module 147, the widget creator module 150may be used by a user to create widgets (e.g., turning a user-specifiedportion of a web page into a widget).

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, and text input module134, search module 151 includes executable instructions to search fortext, music, sound, image, video, and/or other files in memory 102 thatmatch one or more search criteria (e.g., one or more user-specifiedsearch terms) in accordance with user instructions.

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, audio circuitry 110,speaker 111, RF circuitry 108, and browser module 147, video and musicplayer module 152 includes executable instructions that allow the userto download and play back recorded music and other sound files stored inone or more file formats, such as MP3 or AAC files, and executableinstructions to display, present, or otherwise play back videos (e.g.,on touch screen 112 or on an external, connected display via externalport 124). In some embodiments, device 100 optionally includes thefunctionality of an MP3 player, such as an iPod (trademark of AppleInc.).

In conjunction with touch screen 112, display controller 156,contact/motion module 130, graphics module 132, and text input module134, notes module 153 includes executable instructions to create andmanage notes, to-do lists, and the like in accordance with userinstructions.

In conjunction with RF circuitry 108, touch screen 112, displaycontroller 156, contact module 130, graphics module 132, text inputmodule 134, GPS module 135, and browser module 147, map module 154 maybe used to receive, display, modify, and store maps and data associatedwith maps (e.g., driving directions, data on stores and other points ofinterest at or near a particular location, and other location-baseddata) in accordance with user instructions.

In conjunction with touch screen 112, display controller 156, contactmodule 130, graphics module 132, audio circuitry 110, speaker 111, RFcircuitry 108, text input module 134, e-mail client module 140, andbrowser module 147, online video module 155 includes instructions thatallow the user to access, browse, receive (e.g., by streaming and/ordownload), play back (e.g., on the touch screen or on an external,connected display via external port 124), send an e-mail with a link toa particular online video, and otherwise manage online videos in one ormore file formats, such as H.264. In some embodiments, instant messagingmodule 141, rather than e-mail client module 140, is used to send a linkto a particular online video. Additional description of the online videoapplication can be found in U.S. Provisional Patent Application No.60/936,562, “Portable Multifunction Device, Method, and Graphical UserInterface for Playing Online Videos,” filed Jun. 20, 2007, and U.S.patent application Ser. No. 11/968,067, “Portable Multifunction Device,Method, and Graphical User Interface for Playing Online Videos,” filedDec. 31, 2007, the contents of which are hereby incorporated byreference in their entirety.

Each of the above-identified modules and applications corresponds to aset of executable instructions for performing one or more functionsdescribed above and the methods described in this application (e.g., thecomputer-implemented methods and other information processing methodsdescribed herein). These modules (e.g., sets of instructions) need notbe implemented as separate software programs, procedures, or modules,and thus various subsets of these modules may be combined or otherwiserearranged in various embodiments. For example, video player module maybe combined with music player module into a single module (e.g., videoand music player module 152, FIG. 1A). In some embodiments, memory 102may store a subset of the modules and data structures identified above.Furthermore, memory 102 may store additional modules and data structuresnot described above.

In some embodiments, device 100 is a device where operation of apredefined set of functions on the device is performed exclusivelythrough a touch screen and/or a touchpad. By using a touch screen and/ora touchpad as the primary input control device for operation of device100, the number of physical input control devices (such as push buttons,dials, and the like) on device 100 may be reduced.

The predefined set of functions that are performed exclusively through atouch screen and/or a touchpad optionally include navigation betweenuser interfaces. In some embodiments, the touchpad, when touched by theuser, navigates device 100 to a main, home, or root menu from any userinterface that is displayed on device 100. In such embodiments, a “menubutton” is implemented using a touchpad. In some other embodiments, themenu button is a physical push button or other physical input controldevice instead of a touchpad.

FIG. 1B is a block diagram illustrating exemplary components for eventhandling in accordance with some embodiments. In some embodiments,memory 102 (FIG. 1A) or 370 (FIG. 3) includes event sorter 170 (e.g., inoperating system 126) and a respective application 136-1 (e.g., any ofthe aforementioned applications 137-151, 155, 380-390).

Event sorter 170 receives event information and determines theapplication 136-1 and application view 191 of application 136-1 to whichto deliver the event information. Event sorter 170 includes eventmonitor 171 and event dispatcher module 174. In some embodiments,application 136-1 includes application internal state 192, whichindicates the current application view(s) displayed on touch-sensitivedisplay 112 when the application is active or executing. In someembodiments, device/global internal state 157 is used by event sorter170 to determine which application(s) is (are) currently active, andapplication internal state 192 is used by event sorter 170 to determineapplication views 191 to which to deliver event information.

In some embodiments, application internal state 192 includes additionalinformation, such as one or more of: resume information to be used whenapplication 136-1 resumes execution, user interface state informationthat indicates information being displayed or that is ready for displayby application 136-1, a state queue for enabling the user to go back toa prior state or view of application 136-1, and a redo/undo queue ofprevious actions taken by the user.

Event monitor 171 receives event information from peripherals interface118. Event information includes information about a sub-event (e.g., auser touch on touch-sensitive display 112, as part of a multi-touchgesture). Peripherals interface 118 transmits information it receivesfrom I/O subsystem 106 or a sensor, such as proximity sensor 166,accelerometer(s) 168, and/or microphone 113 (through audio circuitry110). Information that peripherals interface 118 receives from I/Osubsystem 106 includes information from touch-sensitive display 112 or atouch-sensitive surface.

In some embodiments, event monitor 171 sends requests to the peripheralsinterface 118 at predetermined intervals. In response, peripheralsinterface 118 transmits event information. In other embodiments,peripherals interface 118 transmits event information only when there isa significant event (e.g., receiving an input above a predeterminednoise threshold and/or for more than a predetermined duration).

In some embodiments, event sorter 170 also includes a hit viewdetermination module 172 and/or an active event recognizer determinationmodule 173.

Hit view determination module 172 provides software procedures fordetermining where a sub-event has taken place within one or more viewswhen touch-sensitive display 112 displays more than one view. Views aremade up of controls and other elements that a user can see on thedisplay.

Another aspect of the user interface associated with an application is aset of views, sometimes herein called application views or userinterface windows, in which information is displayed and touch-basedgestures occur. The application views (of a respective application) inwhich a touch is detected may correspond to programmatic levels within aprogrammatic or view hierarchy of the application. For example, thelowest level view in which a touch is detected may be called the hitview, and the set of events that are recognized as proper inputs may bedetermined based, at least in part, on the hit view of the initial touchthat begins a touch-based gesture.

Hit view determination module 172 receives information related tosub-events of a touch-based gesture. When an application has multipleviews organized in a hierarchy, hit view determination module 172identifies a hit view as the lowest view in the hierarchy which shouldhandle the sub-event. In most circumstances, the hit view is the lowestlevel view in which an initiating sub-event occurs (e.g., the firstsub-event in the sequence of sub-events that form an event or potentialevent). Once the hit view is identified by the hit view determinationmodule 172, the hit view typically receives all sub-events related tothe same touch or input source for which it was identified as the hitview.

Active event recognizer determination module 173 determines which viewor views within a view hierarchy should receive a particular sequence ofsub-events. In some embodiments, active event recognizer determinationmodule 173 determines that only the hit view should receive a particularsequence of sub-events. In other embodiments, active event recognizerdetermination module 173 determines that all views that include thephysical location of a sub-event are actively involved views, andtherefore determines that all actively involved views should receive aparticular sequence of sub-events. In other embodiments, even if touchsub-events were entirely confined to the area associated with oneparticular view, views higher in the hierarchy would still remain asactively involved views.

Event dispatcher module 174 dispatches the event information to an eventrecognizer (e.g., event recognizer 180). In embodiments including activeevent recognizer determination module 173, event dispatcher module 174delivers the event information to an event recognizer determined byactive event recognizer determination module 173. In some embodiments,event dispatcher module 174 stores in an event queue the eventinformation, which is retrieved by a respective event receiver 182.

In some embodiments, operating system 126 includes event sorter 170.Alternatively, application 136-1 includes event sorter 170. In yet otherembodiments, event sorter 170 is a stand-alone module, or a part ofanother module stored in memory 102, such as contact/motion module 130.

In some embodiments, application 136-1 includes a plurality of eventhandlers 190 and one or more application views 191, each of whichincludes instructions for handling touch events that occur within arespective view of the application's user interface. Each applicationview 191 of the application 136-1 includes one or more event recognizers180. Typically, a respective application view 191 includes a pluralityof event recognizers 180. In other embodiments, one or more of eventrecognizers 180 are part of a separate module, such as a user interfacekit (not shown) or a higher level object from which application 136-1inherits methods and other properties. In some embodiments, a respectiveevent handler 190 includes one or more of: data updater 176, objectupdater 177, GUI updater 178, and/or event data 179 received from eventsorter 170. Event handler 190 may utilize or call data updater 176,object updater 177, or GUI updater 178 to update the applicationinternal state 192. Alternatively, one or more of the application views191 include one or more respective event handlers 190. Also, in someembodiments, one or more of data updater 176, object updater 177, andGUI updater 178 are included in a respective application view 191.

A respective event recognizer 180 receives event information (e.g.,event data 179) from event sorter 170 and identifies an event from theevent information. Event recognizer 180 includes event receiver 182 andevent comparator 184. In some embodiments, event recognizer 180 alsoincludes at least a subset of: metadata 183, and event deliveryinstructions 188 (which may include sub-event delivery instructions).

Event receiver 182 receives event information from event sorter 170. Theevent information includes information about a sub-event, for example, atouch or a touch movement. Depending on the sub-event, the eventinformation also includes additional information, such as location ofthe sub-event. When the sub-event concerns motion of a touch, the eventinformation may also include speed and direction of the sub-event. Insome embodiments, events include rotation of the device from oneorientation to another (e.g., from a portrait orientation to a landscapeorientation, or vice versa), and the event information includescorresponding information about the current orientation (also calleddevice attitude) of the device.

Event comparator 184 compares the event information to predefined eventor sub-event definitions and, based on the comparison, determines anevent or sub-event, or determines or updates the state of an event orsub-event. In some embodiments, event comparator 184 includes eventdefinitions 186. Event definitions 186 contain definitions of events(e.g., predefined sequences of sub-events), for example, event 1(187-1), event 2 (187-2), and others. In some embodiments, sub-events inan event (187) include, for example, touch begin, touch end, touchmovement, touch cancellation, and multiple touching. In one example, thedefinition for event 1 (187-1) is a double tap on a displayed object.The double tap, for example, comprises a first touch (touch begin) onthe displayed object for a predetermined phase, a first liftoff (touchend) for a predetermined phase, a second touch (touch begin) on thedisplayed object for a predetermined phase, and a second liftoff (touchend) for a predetermined phase. In another example, the definition forevent 2 (187-2) is a dragging on a displayed object. The dragging, forexample, comprises a touch (or contact) on the displayed object for apredetermined phase, a movement of the touch across touch-sensitivedisplay 112, and liftoff of the touch (touch end). In some embodiments,the event also includes information for one or more associated eventhandlers 190.

In some embodiments, event definition 187 includes a definition of anevent for a respective user-interface object. In some embodiments, eventcomparator 184 performs a hit test to determine which user-interfaceobject is associated with a sub-event. For example, in an applicationview in which three user-interface objects are displayed ontouch-sensitive display 112, when a touch is detected on touch-sensitivedisplay 112, event comparator 184 performs a hit test to determine whichof the three user-interface objects is associated with the touch(sub-event). If each displayed object is associated with a respectiveevent handler 190, the event comparator uses the result of the hit testto determine which event handler 190 should be activated. For example,event comparator 184 selects an event handler associated with thesub-event and the object triggering the hit test.

In some embodiments, the definition for a respective event (187) alsoincludes delayed actions that delay delivery of the event informationuntil after it has been determined whether the sequence of sub-eventsdoes or does not correspond to the event recognizer's event type.

When a respective event recognizer 180 determines that the series ofsub-events do not match any of the events in event definitions 186, therespective event recognizer 180 enters an event impossible, eventfailed, or event ended state, after which it disregards subsequentsub-events of the touch-based gesture. In this situation, other eventrecognizers, if any, that remain active for the hit view continue totrack and process sub-events of an ongoing touch-based gesture.

In some embodiments, a respective event recognizer 180 includes metadata183 with configurable properties, flags, and/or lists that indicate howthe event delivery system should perform sub-event delivery to activelyinvolved event recognizers. In some embodiments, metadata 183 includesconfigurable properties, flags, and/or lists that indicate how eventrecognizers may interact, or are enabled to interact, with one another.In some embodiments, metadata 183 includes configurable properties,flags, and/or lists that indicate whether sub-events are delivered tovarying levels in the view or programmatic hierarchy.

In some embodiments, a respective event recognizer 180 activates eventhandler 190 associated with an event when one or more particularsub-events of an event are recognized. In some embodiments, a respectiveevent recognizer 180 delivers event information associated with theevent to event handler 190. Activating an event handler 190 is distinctfrom sending (and deferred sending) sub-events to a respective hit view.In some embodiments, event recognizer 180 throws a flag associated withthe recognized event, and event handler 190 associated with the flagcatches the flag and performs a predefined process.

In some embodiments, event delivery instructions 188 include sub-eventdelivery instructions that deliver event information about a sub-eventwithout activating an event handler. Instead, the sub-event deliveryinstructions deliver event information to event handlers associated withthe series of sub-events or to actively involved views. Event handlersassociated with the series of sub-events or with actively involved viewsreceive the event information and perform a predetermined process.

In some embodiments, data updater 176 creates and updates data used inapplication 136-1. For example, data updater 176 updates the telephonenumber used in contacts module 137, or stores a video file used in videoplayer module. In some embodiments, object updater 177 creates andupdates objects used in application 136-1. For example, object updater177 creates a new user-interface object or updates the position of auser-interface object. GUI updater 178 updates the GUI. For example, GUIupdater 178 prepares display information and sends it to graphics module132 for display on a touch-sensitive display.

In some embodiments, event handler(s) 190 includes or has access to dataupdater 176, object updater 177, and GUI updater 178. In someembodiments, data updater 176, object updater 177, and GUI updater 178are included in a single module of a respective application 136-1 orapplication view 191. In other embodiments, they are included in two ormore software modules.

It shall be understood that the foregoing discussion regarding eventhandling of user touches on touch-sensitive displays also applies toother forms of user inputs to operate multifunction devices 100 withinput devices, not all of which are initiated on touch screens. Forexample, mouse movement and mouse button presses, optionally coordinatedwith single or multiple keyboard presses or holds; contact movementssuch as taps, drags, scrolls, etc. on touchpads; pen stylus inputs;movement of the device; oral instructions; detected eye movements;biometric inputs; and/or any combination thereof are optionally utilizedas inputs corresponding to sub-events which define an event to berecognized.

FIG. 2 illustrates a portable multifunction device 100 having a touchscreen 112 in accordance with some embodiments. The touch screenoptionally displays one or more graphics within user interface (UI) 200.In this embodiment, as well as others described below, a user is enabledto select one or more of the graphics by making a gesture on thegraphics, for example, with one or more fingers 202 (not drawn to scalein the figure) or one or more styluses 203 (not drawn to scale in thefigure). In some embodiments, selection of one or more graphics occurswhen the user breaks contact with the one or more graphics. In someembodiments, the gesture optionally includes one or more taps, one ormore swipes (from left to right, right to left, upward and/or downward),and/or a rolling of a finger (from right to left, left to right, upwardand/or downward) that has made contact with device 100. In someimplementations or circumstances, inadvertent contact with a graphicdoes not select the graphic. For example, a swipe gesture that sweepsover an application icon optionally does not select the correspondingapplication when the gesture corresponding to selection is a tap.

Device 100 may also include one or more physical buttons, such as “home”or menu button 204. As described previously, menu button 204 may be usedto navigate to any application 136 in a set of applications that may beexecuted on device 100. Alternatively, in some embodiments, the menubutton is implemented as a soft key in a GUI displayed on touch screen112.

In one embodiment, device 100 includes touch screen 112, menu button204, push button 206 for powering the device on/off and locking thedevice, volume adjustment button(s) 208, subscriber identity module(SIM) card slot 210, headset jack 212, and docking/charging externalport 124. Push button 206 is, optionally, used to turn the power on/offon the device by depressing the button and holding the button in thedepressed state for a predefined time interval; to lock the device bydepressing the button and releasing the button before the predefinedtime interval has elapsed; and/or to unlock the device or initiate anunlock process. In an alternative embodiment, device 100 also acceptsverbal input for activation or deactivation of some functions throughmicrophone 113. Device 100 also, optionally, includes one or morecontact intensity sensors 165 for detecting intensity of contacts ontouch screen 112 and/or one or more tactile output generators 167 forgenerating tactile outputs for a user of device 100.

FIG. 3 is a block diagram of an exemplary multifunction device with adisplay and a touch-sensitive surface in accordance with someembodiments. Device 300 need not be portable. In some embodiments,device 300 is a laptop computer, a desktop computer, a tablet computer,a multimedia player device, a navigation device, an educational device(such as a child's learning toy), a gaming system, or a control device(e.g., a home or industrial controller). Device 300 typically includesone or more processing units (CPUs) 310, one or more network or othercommunications interfaces 360, memory 370, and one or more communicationbuses 320 for interconnecting these components. Communication buses 320optionally include circuitry (sometimes called a chipset) thatinterconnects and controls communications between system components.Device 300 includes input/output (I/O) interface 330 comprising display340, which is typically a touch screen display. I/O interface 330 alsooptionally includes a keyboard and/or mouse (or other pointing device)350 and touchpad 355, tactile output generator 357 for generatingtactile outputs on device 300 (e.g., similar to tactile outputgenerator(s) 167 described above with reference to FIG. 1A), sensors 359(e.g., optical, acceleration, proximity, touch-sensitive, and/or contactintensity sensors similar to contact intensity sensor(s) 165 describedabove with reference to FIG. 1A). Memory 370 includes high-speed randomaccess memory, such as DRAM, SRAM, DDR RAM, or other random access solidstate memory devices; and optionally includes non-volatile memory, suchas one or more magnetic disk storage devices, optical disk storagedevices, flash memory devices, or other non-volatile solid state storagedevices. Memory 370 optionally includes one or more storage devicesremotely located from CPU(s) 310. In some embodiments, memory 370 storesprograms, modules, and data structures analogous to the programs,modules, and data structures stored in memory 102 of portablemultifunction device 100 (FIG. 1A), or a subset thereof. Furthermore,memory 370 optionally stores additional programs, modules, and datastructures not present in memory 102 of portable multifunction device100. For example, memory 370 of device 300 optionally stores drawingmodule 380, presentation module 382, word processing module 384, websitecreation module 386, disk authoring module 388, and/or spreadsheetmodule 390, while memory 102 of portable multifunction device 100 (FIG.1A) optionally does not store these modules.

Each of the above-identified elements in FIG. 3 may be stored in one ormore of the previously mentioned memory devices. Each of theabove-identified modules corresponds to a set of instructions forperforming a function described above. The above-identified modules orprograms (e.g., sets of instructions) need not be implemented asseparate software programs, procedures, or modules, and thus varioussubsets of these modules may be combined or otherwise rearranged invarious embodiments. In some embodiments, memory 370 may store a subsetof the modules and data structures identified above. Furthermore, memory370 may store additional modules and data structures not describedabove.

Attention is now directed towards embodiments of user interfaces thatmay be implemented on, for example, portable multifunction device 100.

FIG. 4A illustrates an exemplary user interface for a menu ofapplications on portable multifunction device 100 in accordance withsome embodiments. Similar user interfaces may be implemented on device300. In some embodiments, user interface 400 includes the followingelements, or a subset or superset thereof:

-   -   Signal strength indicator(s) 402 for wireless communication(s),        such as cellular and Wi-Fi signals;    -   Time 404;    -   Bluetooth indicator 405;    -   Battery status indicator 406;    -   Tray 408 with icons for frequently used applications, such as:        -   Icon 416 for telephone module 138, labeled “Phone,” which            optionally includes an indicator 414 of the number of missed            calls or voicemail messages;        -   Icon 418 for e-mail client module 140, labeled “Mail,” which            optionally includes an indicator 410 of the number of unread            e-mails;        -   Icon 420 for browser module 147, labeled “Browser;” and        -   Icon 422 for video and music player module 152, also            referred to as iPod (trademark of Apple Inc.) module 152,            labeled “iPod;” and    -   Icons for other applications, such as:        -   Icon 424 for IM module 141, labeled “Messages;”        -   Icon 426 for calendar module 148, labeled “Calendar;”        -   Icon 428 for image management module 144, labeled “Photos;”        -   Icon 430 for camera module 143, labeled “Camera;”        -   Icon 432 for online video module 155, labeled “Online            Video;”        -   Icon 434 for stocks widget 149-2, labeled “Stocks;”        -   Icon 436 for map module 154, labeled “Maps;”        -   Icon 438 for weather widget 149-1, labeled “Weather;”        -   Icon 440 for alarm clock widget 149-4, labeled “Clock;”        -   Icon 442 for workout support module 142, labeled “Workout            Support;”        -   Icon 444 for notes module 153, labeled “Notes;” and        -   Icon 446 for a settings application or module, labeled            “Settings,” which provides access to settings for device 100            and its various applications 136.

It should be noted that the icon labels illustrated in FIG. 4A aremerely exemplary. For example, icon 422 for video and music playermodule 152 may optionally be labeled “Music” or “Music Player.” Otherlabels are, optionally, used for various application icons. In someembodiments, a label for a respective application icon includes a nameof an application corresponding to the respective application icon. Insome embodiments, a label for a particular application icon is distinctfrom a name of an application corresponding to the particularapplication icon.

FIG. 4B illustrates an exemplary user interface on a device (e.g.,device 300, FIG. 3) with a touch-sensitive surface 451 (e.g., a tabletor touchpad 355, FIG. 3) that is separate from the display 450 (e.g.,touch screen display 112). Device 300 also, optionally, includes one ormore contact intensity sensors (e.g., one or more of sensors 357) fordetecting intensity of contacts on touch-sensitive surface 451 and/orone or more tactile output generators 359 for generating tactile outputsfor a user of device 300.

Although some of the examples which follow will be given with referenceto inputs on touch screen display 112 (where the touch-sensitive surfaceand the display are combined), in some embodiments, the device detectsinputs on a touch-sensitive surface that is separate from the display,as shown in FIG. 4B. In some embodiments, the touch-sensitive surface(e.g., 451 in FIG. 4B) has a primary axis (e.g., 452 in FIG. 4B) thatcorresponds to a primary axis (e.g., 453 in FIG. 4B) on the display(e.g., 450). In accordance with these embodiments, the device detectscontacts (e.g., 460 and 462 in FIG. 4B) with the touch-sensitive surface451 at locations that correspond to respective locations on the display(e.g., in FIG. 4B, 460 corresponds to 468 and 462 corresponds to 470).In this way, user inputs (e.g., contacts 460 and 462, and movementsthereof) detected by the device on the touch-sensitive surface (e.g.,451 in FIG. 4B) are used by the device to manipulate the user interfaceon the display (e.g., 450 in FIG. 4B) of the multifunction device whenthe touch-sensitive surface is separate from the display. It should beunderstood that similar methods are, optionally, used for other userinterfaces described herein.

Additionally, while the following examples are given primarily withreference to finger inputs (e.g., finger contacts, finger tap gestures,finger swipe gestures), it should be understood that, in someembodiments, one or more of the finger inputs are replaced with inputfrom another input device (e.g., a mouse-based input or stylus input).For example, a swipe gesture is, optionally, replaced with a mouse click(e.g., instead of a contact) followed by movement of the cursor alongthe path of the swipe (e.g., instead of movement of the contact). Asanother example, a tap gesture is, optionally, replaced with a mouseclick while the cursor is located over the location of the tap gesture(e.g., instead of detection of the contact followed by ceasing to detectthe contact). Similarly, when multiple user inputs are simultaneouslydetected, it should be understood that multiple computer mice are,optionally, used simultaneously, or a mouse and finger contacts are,optionally, used simultaneously.

As used here, the term “affordance” refers to a user-interactivegraphical user interface object that may be displayed on the displayscreen of devices 100, 300, and/or 500 (FIGS. 1, 3, and 5). For example,an image (e.g., icon), a button, and text (e.g., hyperlink) may eachconstitute an affordance.

Attention is now directed towards embodiments of user interfaces (“UI”)and associated processes that may be implemented on a multifunctiondevice with a display, such as device 300 or portable multifunctiondevice 100.

FIGS. 5A-5I illustrate exemplary user interfaces for linking a paymentaccount to a respective device in accordance with some embodiments. Theuser interfaces in these figures are used to illustrate the processesdescribed below, including the process in FIGS. 6A-6C.

FIGS. 5A-5E illustrate exemplary user interfaces for receiving a requestto link a payment account, such as a bank account or revolving creditaccount, associated with a credit card (e.g., a physical credit card ordebit card issued to a user) to a respective device (e.g., a cell phone,a laptop, a wearable electronic device) in accordance with someembodiments. For example, the request can be to import credit carddetails from a remote server or account, such as iTunes or an accountassociated with iTunes, or to manually entering card details. Therequest includes information about the credit card (e.g., credit cardPrimary Account Number (PAN) or security code).

For example, in FIG. 5A, an electronic wallet is displayed. Theelectronic wallet comprises a first stack of card objects 502 and asecond stack of card objects 508, 510, and 512. The first stack of cardobjects 502 is visually separated from the second stack of card objects508, 510, and 512. In this example, one credit card (e.g., an AmericanExpress credit card) is already linked to the device and is displayed aspart of the first stack of card objects 502. In FIG. 5B, the devicereceives user input which causes the device to reveal an add cardaffordance 520 for the request to link a payment account (e.g., arevolving credit account held with a financial institution) to therespective device. For example, a downward swipe on the display ofdevice 100 is used to reveal the add card affordance 520. The devicereceives a selection of (e.g., a finger tap to activate) the add cardaffordance 520 and displays the user interface of FIG. 5C.

FIG. 5C illustrates a user interface for selecting from among an addpayment card affordance 530 to link a payment account to the device(e.g., to make the payment account available in the electronic wallet)and a scan code affordance 532 to link a pass. If the device determinesthat selection of done affordance 534 is received, the device returns todisplaying the electronic wallet of FIG. 5A. If the device determinesthat selection of add payment card affordance 530 is received, thedevice transitions to display of FIG. 5D.

In FIG. 5D, the device displays a generic image of a debit or creditcard 536 to indicate to the user that the user is attempting to requestlinking a payment account to the respective device. In one exemplaryembodiment, the device displays, on the display, a credit card importaffordance 538 for importing, from a remote server (e.g., iTunes or anaccount associated with iTunes), at least partial credit cardinformation (e.g., information for a credit card that has beenauthorized for use by a current user account). The device receives userselection of the credit card import affordance 538 (e.g., a finger tapon the credit card import affordance 538). Alternatively, the user maymanually enter credit card information (e.g., card number, cardexpiration date, name on card) by selecting manual entry affordance 540or manually enter credit card information (e.g., card number, cardexpiration date, name on card) using a camera of the device by selectingcamera entry affordance 542.

In response to receiving the user selection of the credit card importaffordance 538 for importing credit card information (e.g., card number,card expiration date, name on card) from the remote server, the devicedisplays a credit card details screen, as illustrated in FIG. 5E. Thecredit card details screen includes an indication 554 of a credit cardnumber (e.g., credit card Primary Account Number (PAN) truncationdisplaying the last four digits of the credit card) of the credit cardassociated with the payment account and includes a security code inputfield 550 for receiving a security code (e.g., a numerical card securitycode such as CVD, CVV, CVC).

The device receives a respective security code at the security codeinput field 550 through user input (e.g., user input at displayed keypad552 or through taking a picture of the credit card). The devicedetermines validity of the credit card using verification based on thecredit card number and the respective security code. In someembodiments, after determining that the credit card is valid, thepayment account associated with the credit card is linked to therespective device.

In some embodiments, the user requests to manually input credit cardinformation (e.g., card number, card expiration date, name on card),rather than import credit card information. At FIG. 5D, the user maymanually enter credit card information by selecting manual entryaffordance 540 or by selecting camera entry affordance 542. In responseto receiving the user selection of the credit card input affordance forinputting credit card information, the device displays a credit carddetails screen for manual entry. The credit card details screen formanual entry includes an account input field for receiving a credit cardnumber (e.g., credit card Primary Account Number) associated with thepayment account and includes a security code input field for receiving asecurity code (e.g., a numerical card security code such as CVD, CVV,CVC). The device receives a respective credit card number at the accountinput field and a respective security code at the security code inputfield through user input (e.g., user input at a displayed keypad orthrough taking a picture of the credit card). The device determinesvalidity of the credit card using verification based on the respectivecredit card number and the respective security code. In someembodiments, after determining that the credit card is valid, thepayment account associated with the credit card is linked to therespective device.

Similarly, selecting camera entry affordance 542 of FIG. 5D allows theuser to request to enter information using the camera by taking one ormore images of the credit card (e.g., the user takes pictures of thefront and/or back of a credit card using the device). The devicedetermines the credit card number and corresponding security code CCVbased on one or more images of the credit card for determining that thecredit card is valid. In some embodiments, after determining that thecredit card is valid, the payment account associated with the creditcard is linked to the respective device.

In response to receiving the request (e.g., the user imports the creditcard information), the device determines whether further verification isneeded to link the payment account to the respective device (e.g., isthe payment account already approved by the bank to be linked to adevice or does the bank first need to confirm with the payment accountowner). In accordance with a determination that further verification isnot needed to link the payment account to the respective device, thedevice links the payment account to the respective device and providesan indication (e.g., 558 of FIG. 5H) that the payment account has beenlinked to the respective device. Once the payment account is linked tothe respective device, the respective device may be used to facilitatepayment transactions (e.g., making a purchase in a physical store or apurchase through the Internet using the respective device).

FIG. 5G illustrates an exemplary user interface including an indication556 that further verification is needed. In accordance with adetermination that further verification is needed to link the paymentaccount to the respective device, the device provides an indication thatfurther verification is needed to link the payment account to therespective device (e.g., displaying on the display that approval forlinking the payment account is pending or requesting the user to call aphone number for verification). In some embodiments, the indication thatfurther verification is needed to link the payment account to therespective device includes an alphanumeric visual indicator displayed onthe display of the electronic device (e.g., the alphanumeric indicatorcomprising “approval pending” that indicates that further verificationsteps have been initiated without additional user input). An examplevisual indictor is illustrated as visual indication 556 “approvalpending” of FIG. 5G. For example, a financial institution (e.g., a bank)associated with the payment account may need to confirm details of thepayment account before the payment account is linked to the respectivedevice. The verification may not require additional user interactionwith the financial institution.

FIG. 5F illustrates an exemplary user interface that illustrates anindication that further verification is needed to link the paymentaccount to the respective device. In some embodiments, the indicationthat further verification is needed to link the payment account to therespective device includes a visual indication of additional steps to betaken by a user to link the payment account to the respective device(e.g., instructions for the user to contact the financial institutionassociated with the payment account to confirm details of the paymentaccount before the payment account is linked to the respective device).

In FIG. 5F, the device displays a plurality of communication methodaffordances 560 and 562. In some embodiments, in accordance with thedetermination that further verification is needed to link the paymentaccount to the respective device, the device displays, on the display,the plurality of communication method affordances 560 and 562. Eachcommunication method affordance is associated with a respectivecommunication method (e.g., the phone number the bank should call, thephone number the user should call, the email address the bank shouldemail, the telephone number the bank should text) for a verificationcommunication (e.g., telephone call where the bank calls the user or theuser calls the bank and keys in identification information, email thatprovides a code or a link to a website for entering verificationinformation, or text message that includes information for verifying).For example, the device may display a communication method affordance560 indicating the phone number that the financial institution shouldcall for the further verification to link the payment account. Foranother example, the device may display a communication methodaffordance 562 indicating the email address that the financialinstitution should email for the further verification to link thepayment account. The plurality of communication method affordances 560and 562 may be based on communication received from the financialinstitution. For example, the financial institution may provide thecommunication methods for security purposes, rather than usingcommunication methods from the device or communication methods that areinput at the device by the user. The communication method affordances560 and 562 indicating the communication methods display only part ofthe communication method contact information, such as the last 4 digitsof phone number or the domain of the email address. This providesadditional security in the event that a user attempts to link a paymentaccount not belonging to the user.

In some embodiments, in accordance with the determination that furtherverification is needed to link the payment account to the respectivedevice, the device displays, on the display, a plurality ofcommunication method affordances 560 and 562, wherein each communicationmethod affordance is associated with a respective communication method(e.g., the phone number the bank should call, the phone number the usershould call, the email address the bank should email, the telephonenumber the bank should text) for a verification communication. Thedisplay of the plurality of communication method affordances 560 and 562are based on locally-stored contact information. For example, thelocally-stored contact information includes the respective communicationmethods. This allows the user to select a communication method for theverification that the financial institution may not be aware of (e.g.,the user gets a new electronic device with a newly assigned phone numberand prefers to use the newly assigned phone number for the verificationcommunication). The locally-stored contact information may be a contactinformation card associated with the user (e.g., an entry in the phonebook of the device identified as containing the user's contactinformation) of the electronic device.

In some embodiments, in accordance with the determination that furtherverification is needed to link the payment account to the respectivedevice, the device receives a selection of a communication methodaffordance of the plurality of communication method affordances 560 and562. In response to receiving the selection of the communication methodaffordance, the device transmits, to the financial institution, anindication of the respective communication method of the selectedcommunication method affordance (e.g., tell the financial institutionthat the user prefers to be contacted at their desk phone and display onthe device that the financial institution will contact the user at theselected phone number). The verification communication (e.g., telephonecall where the bank calls the user or the user calls the bank and keysin identification information, email that provides a code or a link to awebsite for entering verification information, or text message thatincludes information for verifying) is based on the communication methodaffordance. Thus, the verification communication allows the financialinstitution to efficiently contact the user to provide identifyinginformation or verification to link the payment account.

In some embodiments, in accordance with the determination that furtherverification is needed to link the payment account to the respectivedevice, the device receives a verification communication (e.g.,telephone call, email, or text message) from the financial institutionassociated with the payment account. The verification communication isfor verification (e.g., confirming identify of requestor) to link thepayment account to the respective device.

In some embodiments, in accordance with the determination that furtherverification is needed to link the payment account to the respectivedevice, the device receives a request from a user to initiate averification communication (e.g., telephone call where the bank callsthe user or the user calls the bank and keys in identificationinformation, email that provides a code or a link to a website forentering verification information, or text message that includesinformation for verifying) with the financial institution. In responseto receiving the request to initiate the verification communication, thedevice initiates the verification communication with the financialinstitution associated with the payment account. If an application forthe financial institution is installed on the device, the device mayoffer to start application to enter identification/authorizationinformation. If the application is downloaded on a different deviceowned by the user, the device may prompt the user to download theapplication onto the device. The verification communication is forverification (e.g., confirming identify of requestor) to link thepayment account to the respective device. In some embodiments, therequest to initiate verification communication includes personallyidentifying information.

In some embodiments, the device receives a notification (e.g., thedevice intercepts a text message, email message, or push notificationsent to the device that includes a confirmation code) at the electronicdevice. The notification comprises a verification code for linking thepayment account to the respective device. In response to receiving thenotification comprising the verification code at the electronic device,the device links the payment account to the respective device. In someembodiments, the notification is hidden from the user either by deletingthe notification or by forgoing displaying a receipt of thenotification. For example, a text message with a verification code isreceived at a phone and upon receiving the text message, the phonetransmits the verification code to the financial institution to verifythat the user is in possession of the phone and, optionally, deletes thetext message or does not display a notification of the text message and,instead, removes the “approval pending” indicator and visually indicatesthat the payment account has been linked to the device.

In some embodiments, the device displays a confirmation on the displayindicating that the payment account has been linked to the respectivedevice comprising displaying a notification (e.g., a pop-up or bannerfrom the electronic wallet application) on the device indicating thatthe payment account has been linked to the respective device, such as“approved” confirmation 558 illustrated in FIG. 5H. The notification maybe displayed while accessing the electronic wallet or while a differentapplication (or no application) is being displayed.

In some embodiments, the device receives a user input requesting asecondary verification code (e.g., user activates an affordance torequest verification again) for linking the payment account to therespective device. For example, the user can access the electronicwallet and select a “re-verify” affordance. In response to receiving theinput requesting the secondary verification code, the device transmits arequest to the financial institution to request the secondaryverification code (e.g., in case the first verification code is notreceived or expires before verification is complete).

In some embodiments, the device receives a secondary notification (e.g.,the device intercepts a text message, email message, or pushnotification that includes a confirmation code) at the electronicdevice. The secondary notification comprises the secondary verificationcode for linking the payment account to the respective device. Inresponse to receiving the secondary notification comprising thesecondary verification code at the electronic device, the device linksthe payment account to the respective device and displays a confirmation(e.g., “approved” 558 of FIG. 5H) on the device indicating that thepayment account has been linked to the respective device.

In some embodiments, the device receives a primary account number (e.g.,Digital PAN, DPAN, a 16-digit account number, or other account number,which, for example, cannot be used for completing a manual transactionover a voice call—only for completing a payment electronically throughthe device) from the financial institution for use in authorizingpayments from the payment account using the respective device. Thereceived primary account number is different than the account numberdisplayed on the credit card (e.g., credit card PAN, 16-digit creditcard number). In some embodiments, the device assigns the receivedprimary account number (e.g., Digital PAN, DPAN, a 16-digit accountnumber, or other account number) to the respective device to link thepayment account to the respective device. This may, for example, allowthe financial institution to differentiate between payment transactionsconducted using the received primary account number, which is associatedwith the payment account, assigned to the respective device and paymenttransactions conducted using the credit card, which is also associatedwith the payment account.

In some embodiments, the credit card details screen of FIG. 5E includesa displayed visual graphical representation 504 of the credit cardassociated with the payment account. For example, the graphicalrepresentation comprises the background image of the physical creditcard associated with the payment account when the user selects to importcredit card information. Displaying the same background image as thephysical credit card allows the user to easily recognize which creditcard is being used for linking the payment account.

In some embodiments, the respective device is a second electronic device(e.g., a cell phone, a laptop, a wearable electronic device) that isseparate from the electronic device. For example, the electronic devicecan be used to link the payment account to a separate cell phone. Thismay be done, for example, by transmitting provisioning information fromthe electronic device to the respective device (e.g., the separatedevice), wherein the provisioning information is used to link thepayment account to the respective device (e.g., the separate device). Insome embodiments, a similar process can be repeated to link the paymentaccount to the electronic device (optionally with a different DPAN). Inanother embodiment, the respective device is the same as the electronicdevice, and the electronic device is a mobile telecommunications device(e.g., a cell phone, a laptop, a wearable electronic device).

In some embodiments, the device determines (e.g., prior to linking thepayment account to the respective device) whether the respective deviceis configured to require an unlock authorization (e.g., passcode) forunlocking the respective device. In accordance with a determination thatthe respective device is not configured to require an unlockauthorization, the device displays, on the display, an unlockauthorization configurator for configuring the respective device torequire unlock authorization for unlocking or accessing certain featuresof the respective device. This provides additional security by requiringthat the respective device have a lock authorization to access thedevice under (at least some) circumstances. For example, theauthorization configurator may be used to enroll a fingerprint orpasscode that is enabled to authorize payment transactions.

FIG. 5I illustrates an electronic wallet that includes representationsof multiple payment accounts 502 and 504. In some embodiments, thedevice receives a second request to link a second payment account (e.g.,a revolving credit account with a financial institution) associated witha second credit card to the respective device. The second requestincludes information about the second credit card (e.g., selecting thecredit card for import and/or entering the card security code). Forexample, a similar technique, as discussed above, may be used forrequesting to link the second payment account to the respective device.The device links the second payment account to the respective device andprovides an indication that the second payment account has been linkedto the respective device. The device receives a selection from among atleast the payment account and the second payment account specifying thedefault payment account to be used for payment transactions.

FIGS. 6A-6C are flow diagrams illustrating method 600 for linking apayment account to a respective device in accordance with someembodiments. Method 600 is performed at a device (e.g., device 300, FIG.3, or portable multifunction device 100, FIG. 1) with a display. Someoperations in method 600 may be combined, the order of some operationsmay be changed, and some operations may be omitted.

As described below, method 600 provides an intuitive way to link apayment account to a respective device. The method reduces the cognitiveburden on a user when linking the payment account, thereby creating amore efficient human-machine interface. For battery-operated computingdevices, enabling a user to link a payment account to a respectivedevice faster and more efficiently conserves power and increases thetime between battery charges.

At block 602, the electronic device receives a request (e.g., request toimport card details from iTunes or manually entering card details) tolink a payment account (e.g., a revolving credit account held with afinancial institution) associated with a credit card (e.g., a physicalcredit card or debit card issued to the user) to a respective device(e.g., a cell phone, a laptop, a wearable electronic device, device 300,FIG. 3, or portable multifunction device 100, FIG. 1), wherein therequest includes information about the credit card (e.g., entering thecard security code).

At block 604, in some embodiments, receiving the request to link thepayment account comprises receiving a request to import credit cardinformation. The device displays on the display, a credit card importaffordance for importing, from a remote server, at least partial creditcard information (e.g., information for a credit card that has beenauthorized for use by a current user account). The device receives userselection of the credit card import affordance. In response to receivingthe user selection of the credit card import affordance for importingcredit card information from the remote server: the device displays acredit card details screen, wherein the credit card details screenincludes an indication of a credit card number (e.g., credit cardPrimary Account Number (PAN) truncation displaying the last four digitsof the credit card) of the credit card associated with the paymentaccount and includes a security code input field for receiving asecurity code (e.g., a numerical card security code such as CVD, CVV,CVC); the device receives a respective security code at the securitycode input field through user input (e.g., user input at a displayedkeypad or through taking a picture of the credit card); and the devicedetermines validity of the credit card using verification based on thecredit card number and the respective security code. In someembodiments, after determining that the credit card is valid, thepayment account associated with the credit card is linked to therespective device.

At block 606, in some embodiments, receiving the request to link thepayment account comprises receiving a request to manually enter creditcard information. The device displays, on the display, a credit cardinput affordance for receiving credit card information through userinput at the electronic device. The device receives user selection ofthe credit card input affordance. In response to receiving the userselection of the credit card input affordance for inputting credit cardinformation: the device displays a credit card details screen, whereinthe credit card details screen includes an account input field forreceiving a credit card number (e.g., credit card Primary AccountNumber) associated with the payment account and includes a security codeinput field for receiving a security code (e.g., a numerical cardsecurity code such as CVD, CVV, CVC); the device receives a respectivecredit card number at the account input field and a respective securitycode at the security code input field through user input (e.g., userinput at a displayed keypad or through taking a picture of the creditcard); and the device determines validity of the credit card usingverification based on the respective credit card number and therespective security code. In some embodiments, after determining thatthe credit card is valid, the payment account associated with the creditcard is linked to the respective device.

At block 608, in response to receiving the request to link the paymentaccount, the device determines at block 610 whether further verificationis needed to link the payment account to the respective device (e.g., isit already approved by the bank or does the bank need to confirm withthe user). At block 612, in accordance with a determination that furtherverification is not needed to link the payment account to the respectivedevice, the device links the payment account to the respective deviceand provides an indication that the payment account has been linked tothe respective device.

At block 614, in accordance with a determination that furtherverification is needed to link the payment account to the respectivedevice, the device provides an indication that further verification isneeded to link the payment account to the respective device (e.g.,displaying on the display that approval for linking the payment accountis pending).

In some embodiments, the indication that further verification is neededto link the payment account to the respective device includes analphanumeric visual indicator displayed on the display of the electronicdevice (e.g., the alphanumeric indicator comprising “approval pending”that indicates that further verification steps have been initiatedwithout additional user input, visual indication 556 of FIG. 5G). Forexample, a financial institution associated with the payment account mayneed to confirm details of the payment account before the paymentaccount is linked to the respective device. The verification may notrequire additional user interaction with the financial institution.

In some embodiments, the indication that further verification is neededto link the payment account to the respective device includes a visualindication of additional steps to be taken by a user to link the paymentaccount to the respective device (e.g., instructions for the user tocontact the financial institution associated with the payment account toconfirm details of the payment account before the payment account islinked to the respective device).

At block 616, in some embodiments, in accordance with the determinationthat further verification is needed to link the payment account to therespective device, the device displays, on the display, the plurality ofcommunication method affordances (e.g., 560 and 562 of FIG. 5F). Eachcommunication method affordance is associated with a respectivecommunication method (e.g., the phone number the bank should call, thephone number the user should call, the email address the bank shouldemail, the telephone number the bank should text) for a verificationcommunication (e.g., telephone call where the bank calls the user or theuser calls the bank and keys in identification information, email thatprovides a code or a link to a website for entering verificationinformation, or text message that includes information for verifying).

In some embodiments, in accordance with the determination that furtherverification is needed to link the payment account to the respectivedevice, the device displays, on the display, a plurality ofcommunication method affordances (e.g., 560 and 562 of FIG. 5F), whereineach communication method affordance is associated with a respectivecommunication method (e.g., the phone number the bank should call, thephone number the user should call, the email address the bank shouldemail, the telephone number the bank should text) for a verificationcommunication. The display of the plurality of communication methodaffordances are based on locally-stored contact information. Forexample, the locally-stored contact information includes the respectivecommunication methods. This allows the user to select a communicationmethod for the verification that the financial institution may not beaware of (e.g., the user gets a new electronic device with a newlyassigned phone number and prefers to use the newly assigned phone numberfor the verification communication). The locally-stored contactinformation may be a contact information card associated with the user(e.g., an entry in the phone book of the device identified as containingthe user's contact information) of the electronic device.

At block 618, in some embodiments, in accordance with the determinationthat further verification is needed to link the payment account to therespective device, the device receives a selection of a communicationmethod affordance of the plurality of communication method affordances(e.g., 560 and 562 of FIG. 5F). In response to receiving the selectionof the communication method affordance, the device transmits, to thefinancial institution, an indication of the respective communicationmethod of the selected communication method affordance (e.g., tell thefinancial institution that the user prefers to be contacted at theirdesk phone and display on the device that the financial institution willcontact the user at the selected phone number). The verificationcommunication (e.g., telephone call where the bank calls the user or theuser calls the bank and keys in identification information, email thatprovides a code or a link to a website for entering verificationinformation, or text message that includes information for verifying) isbased on the communication method affordance. Thus, the verificationcommunication allows the financial institution to efficiently contactthe user to provide identifying information or verification to link thepayment account.

At block 620, in some embodiments, in accordance with the determinationthat further verification is needed to link the payment account to therespective device, the device receives a verification communication(e.g., telephone call, email, or text message) from the financialinstitution associated with the payment account. The verificationcommunication is for verification (e.g., confirming identify ofrequestor) to link the payment account to the respective device.

At block 622, in some embodiments, in accordance with the determinationthat further verification is needed to link the payment account to therespective device, the device receives a request from a user to initiatea verification communication (e.g., telephone call where the bank callsthe user or the user calls the bank and keys in identificationinformation, email that provides a code or a link to a website forentering verification information, or text message that includesinformation for verifying) with the financial institution. In responseto receiving the request to initiate the verification communication, thedevice initiates the verification communication with the financialinstitution associated with the payment account. The verificationcommunication is for verification (e.g., confirming identify ofrequestor) to link the payment account to the respective device. In someembodiments, the request to initiate verification communication includespersonally identifying information.

At block 624, in some embodiments, the device receives a notification(e.g., the device intercepts a text message, email message, or pushnotification sent to the device that includes a confirmation code) atthe electronic device. The notification comprises a verification codefor linking the payment account to the respective device. In response toreceiving the notification comprising the verification code at theelectronic device, the device links the payment account to therespective device. In some embodiments, the notification is hidden fromthe user either by deleting the notification or by forgoing displaying areceipt of the notification. For example, a text message with averification code is received at a phone and, upon receiving the textmessage, the phone transmits the verification code to the financialinstitution to verify that the user is in possession of the phone and,optionally, deletes the text message or does not display a notificationof the text message and, instead, removes the “approval pending”indicator and visually indicates that the payment account has beenlinked to the device.

At block 626, in some embodiments, the device displays a confirmation(e.g., 558 of FIG. 5H) on the display indicating that the paymentaccount has been linked to the respective device comprising displaying anotification (e.g., a pop-up or banner from the electronic walletapplication) on the device indicating that the payment account has beenlinked to the respective device. The notification may be displayed whileaccessing the electronic wallet or while a different application (or noapplication) is being displayed.

In some embodiments, the device receives a user input requesting asecondary verification code (e.g., user activates an affordance torequest verification again) for linking the payment account to therespective device. For example, the user can access the electronicwallet and select a “re-verify” affordance. In response to receiving theinput requesting the secondary verification code, the device transmits arequest to the financial institution to request the secondaryverification code (e.g., in case the first verification code is notreceived or expires before verification is complete).

In some embodiments, the device receives a secondary notification (e.g.,the device intercepts a text message, email message, or pushnotification that includes a confirmation code) at the electronicdevice. The secondary notification comprises the secondary verificationcode for linking the payment account to the respective device. Inresponse to receiving the secondary notification comprising thesecondary verification code at the electronic device, the device linksthe payment account to the respective device and displays a confirmation(e.g., 558 of FIG. 5H) on the device indicating that the payment accounthas been linked to the respective device.

At block 628, in some embodiments, the device receives a primary accountnumber (e.g., Digital PAN, DPAN, a 16-digit account number, or otheraccount number, which, for example cannot be used for completing amanual transaction over a voice call—only for completing a paymentelectronically through the device.) from the financial institution foruse in authorizing payments from the payment account using therespective device. The received primary account number is different thanthe account number displayed on the credit card (e.g., credit card PAN,16-digit credit card number). At block 630, in some embodiments, thedevice assigns the received primary account number (e.g., Digital PAN,DPAN, a 16-digit account number, or other account number) to therespective device to link the payment account to the respective device.This may, for example, allow the financial institution to differentiatebetween payment transactions conducted using the received primaryaccount number, which is associated with the payment account, assignedto the respective device and payment transactions conducted using thecredit card, which is also associated with the payment account.

In some embodiments, the credit card details screen (e.g., of FIG. 5E)includes a displayed visual graphical representation (e.g., 504 of FIG.5E) of the credit card associated with the payment account. For example,the graphical representation comprises the background image of thephysical credit card associated with the payment account when the userselects to import credit card information. Displaying the samebackground image as the physical credit card allows the user to easilyrecognize which credit card is being used for linking the paymentaccount.

In some embodiments, the respective device is a second electronic device(e.g., a cell phone, a laptop, a wearable electronic device) that isseparate from the electronic device. For example, the electronic devicecan be used to link the payment account to a separate cell phone. Thismay be done, for example, by transmitting provisioning information fromthe electronic device to the respective device (e.g., the separatedevice), wherein the provisioning information is used to link thepayment account to the respective device (e.g., the separate device). Insome embodiments, a similar process can be repeated to link the paymentaccount to the electronic device (optionally with a different DPAN). Inanother embodiment, the respective device is the same as the electronicdevice, and the electronic device is a mobile telecommunications device(e.g., a cell phone, a laptop, a wearable electronic device).

At block 632, in some embodiments, the device determines (e.g., prior tolinking the payment account to the respective device) whether therespective device is configured to require an unlock authorization(e.g., passcode) for unlocking the respective device. In accordance witha determination that the respective device is not configured to requirean unlock authorization, the device displays, on the display, an unlockauthorization configurator for configuring the respective device torequire unlock authorization for unlocking or accessing certain featuresof the respective device. This provides additional security by requiringthat the respective device have a lock authorization to access thedevice under (at least some) circumstances. For example, theauthorization configurator may be used to enroll a fingerprint orpasscode that is enabled to authorize payment transactions. In someembodiments, the device links the payment account to the respectivedevice after completing the unlock authorization configurator process.

At block 634, in some embodiments, the device receives a second requestto link a second payment account (e.g., a revolving credit account witha financial institution) associated with a second credit card to therespective device. The second request includes information about thesecond credit card (e.g., selecting the credit card for import and/orentering the card security code). For example, a similar technique asdiscussed above may be used for requesting to link the second paymentaccount to the respective device. The device links the second paymentaccount to the respective device and provides an indication that thesecond payment account has been linked to the respective device. Thedevice receives a selection from among at least the payment account andthe second payment account specifying the default payment account to beused for payment transactions.

Note that details of the processes described above with respect tomethod 600 (e.g., FIGS. 6A-6C and 5A-5I) are also applicable in ananalogous manner to the methods described below. For example, methods800, 1000, 1200, 1400, 1600, 1800, 2000, and 2200 may include one ormore of the characteristics of the various methods described above withreference to method 600. For brevity, these details are not repeatedbelow.

The operations described above with reference to the figures may beimplemented by components depicted in FIGS. 1A-1B. For example, receiveoperations, display operations, and determination operations may beimplemented by event sorter 170, event recognizer 180, and event handler190. Event monitor 171 in event sorter 170 detects a contact ontouch-sensitive display 112, and event dispatcher module 174 deliversthe event information to application 136-1. A respective eventrecognizer 180 of application 136-1 compares the event information torespective event definitions 186, and determines whether a first contactat a first location on the touch-sensitive surface corresponds to apredefined event or sub-event, such as selection of an object on a userinterface. When a respective predefined event or sub-event is detected,event recognizer 180 activates an event handler 190 associated with thedetection of the event or sub-event. Event handler 190 may utilize orcall data updater 176 or object updater 177 to update the applicationinternal state 192. In some embodiments, event handler 190 accesses arespective GUI updater 178 to update what is displayed by theapplication. Similarly, it would be clear to a person having ordinaryskill in the art how other processes can be implemented based on thecomponents depicted in FIGS. 1A-1B.

FIGS. 7A-7O illustrate exemplary techniques and user interfaces forproceeding with a payment transaction using a short-range communicationradio, such as a near field communication (NFC) radio, in accordancewith some embodiments. The techniques and user interfaces in thesefigures are used to illustrate the processes described below, includingthe process in FIGS. 8A-8B.

FIGS. 7A-7B illustrate an exemplary technique for proceeding with apayment transaction using a short-range communication radio, such as aNFC radio. The NFC standards, which are related to radio-frequencyidentification (RFID) standards, describe communication protocols fortransferring information between two devices, such as for makingpayments. It should be appreciated, however, that other communicationsstandards and techniques may also be used.

Multifunction device 100 (and device 300) may include near fieldcommunications circuitry, such as a short range communication radio.Accordingly, device 100 can wirelessly communicate with externalequipment, such as NFC-enabled contactless payment transaction terminal2000, using near field communications. For example, the near fieldcommunications circuitry in device 100 may include a near fieldtransmitter and a near field receiver. Near field communications fordevice 100 may be supported using capacitive coupling near fieldcommunications structures and/or inductive coupling near fieldcommunications structures. In near field communications techniques,wireless signals are typically conveyed, for example, over distances of1 m or less, 100 cm or less, 10 cm or less, or 1 cm or less, and are notconveyed over longer distances.

In FIG. 7A, the NFC-enabled contactless payment transaction terminal2000 generates a field 2002. For example, an NFC-enabled device thatenters the field 2002 can communicate with the contactless paymenttransaction terminal 2000 using NFC. In FIG. 7A, the electronic device100 has not been placed in the field 2002. The contactless paymenttransaction terminal 2000 may be part of a payment system (e.g., checkregister) installed in a retail store for processing paymenttransactions, such as purchases of products and services.

In some embodiments, electronic device 100 receives authorization (e.g.,from the user, as described in detail below) to proceed with a paymenttransaction prior to detecting presence of the field 2002 (e.g., an NFCcompliant RF field) generated by the contactless payment transactionterminal 2000. The authorization is only valid for a predeterminedperiod of time (e.g., up to 30 seconds). If the user places the deviceinto field 2002 after receiving authorization and before thepredetermined period of time has elapsed, the device will proceed withthe payment transaction (e.g., a payment of funds being solicited by thecontactless payment transaction terminal 2000). After the predeterminedperiod of time has elapsed, the device will no longer have authorizationto proceed with the payment transaction (unless the user authorizes thedevice again), and accordingly the device will not proceed with thepayment transaction, even if placed within range of the field 2002.Thus, the device does not stay authorized indefinitely after receivingauthorization to proceed with a payment transaction.

In FIG. 7B, the user places the electronic device 100 into the field2002. The electronic device detects, by the short-range communicationradio of the electronic device, presence of the field 2002 (e.g., theNFC compliant RF field) generated by the contactless payment transactionterminal 2000 (e.g., an NFC-compliant payment transaction terminal). Insome embodiments, the electronic device detects the field andcommunication initiation signal from the contactless payment transactionterminal 2000. In response to detecting presence of the field 2002generated by the contactless payment transaction terminal 2000, thedevice determines whether authorization to proceed with a paymenttransaction is provided. For example, the device determines whether thedevice has been pre-authorized by the user (e.g., prior to the devicedetecting the field 2002, as discussed above) for proceeding withpayment transactions or whether the user is currently authorizing thedevice to proceed with the payment transaction (e.g., the user hasplaced a finger on a fingerprint sensor for authorization).

In some embodiments, while the device is within range of the fieldgenerated by the contactless payment transaction terminal, the devicedetects a respective fingerprint on a fingerprint sensor of theelectronic device. In response to detecting the respective fingerprinton the fingerprint sensor, the device determines whether the fingerprintis consistent with an enrolled fingerprint that is enabled to authorizepayment transactions. In accordance with a determination that arespective fingerprint is consistent with the enrolled fingerprint, thedevice authorizes the payment transaction. For example, a user placestheir finger on the fingerprint sensor of the device (e.g., withoutturning on the display of the device or opening any particularapplication) and then places the device into the field 2002. When thedevice detects the field 2002, the device reads the fingerprint anddetermines that the user has provided authorization to make a paymentusing the device. In accordance with a determination that the respectivefingerprint is not consistent with the enrolled fingerprint, the deviceforgoes authorization of the payment transaction. In other words, thedevice is not authorized to proceed with the payment transaction,meaning authorization is still required to proceed with the paymenttransaction.

In some embodiments, the user interface of the electronic device islocked when presence of the field generated is detected and the displayof the electronic device is off when presence of the field generated isdetected. In response to detecting the presence of the field 2002generated by the contactless payment transaction terminal 2002, thedevice turns the display on.

FIG. 7C illustrates an exemplary user interface for authorizing thedevice in order to proceed with the payment transaction. In someembodiments, in response to detecting presence of the field 2002generated by the contactless payment transaction terminal 2000, thedevice displays an electronic wallet, as illustrated in FIG. 7C (e.g.,if the device is placed in range of the field 2002 while the device isunlocked). The electronic wallet includes a plurality of payment cardaffordances (such as payment card affordances 704 and 708). For example,the user interface of FIG. 7C allows the user to easily determine whichpayment account will be used if the device proceeds with the paymenttransaction. In this example, the payment card affordance 704 isdisplayed at the top of the display, indicating that the payment accountassociated with the payment card affordance 704 will be used forpayment.

In accordance with a determination that authorization to proceed withthe payment transaction has been provided (e.g., the user providedauthorization prior to entering the field 2002 or the user providesauthorization while the device is in the field 2002), the deviceproceeds with the payment transaction with the contactless paymenttransaction terminal 2000 (e.g., transmitting an identifier such as aPAN to the contactless payment transaction terminal 2000 for use incompleting the payment transaction).

In some embodiments, proceeding with the payment transaction with thecontactless payment transaction terminal 2002 comprises using a linkedpayment account (e.g., a payment account linked to the electronic deviceand stored in an electronic wallet) to complete the payment transaction.In some embodiments, proceeding with the payment transaction with thecontactless payment transaction terminal 2002 comprises using a primaryaccount number for use in the payment transaction (e.g., using thecredit account to make the purchase) to complete the paymenttransaction, where the primary account number is stored on theelectronic device.

In some embodiments, in accordance with the determination thatauthorization to proceed with the payment transaction has been provided,the device determines whether the payment transaction is successfullycompleted. In response to determining the payment transaction issuccessfully completed, the device plays, at the electronic device, asuccess audio alert. The success audio alert indicates that the paymenttransaction is successfully completed. In some embodiments, the successaudio alert is different than a failure audio alert.

Similarly, providing non-audio notifications to the user of the deviceis helpful for the user to understand whether additional input isrequired. In some embodiments, in accordance with the determination thatauthorization to proceed with the payment transaction has been provided(e.g., the device is armed), the device determines whether the paymenttransaction is successfully completed. In response to determining thepayment transaction is successfully completed, the device causes asuccess haptic alert indicating that the payment transaction issuccessfully completed. In one example, the success haptic alert isdifferent than a failure haptic alert. For example, the failure hapticalert is longer in duration and more intense than the success hapticalert.

FIG. 7C illustrates an exemplary user interface for authorizing thedevice in order to proceed with the payment transaction. In accordancewith a determination that authorization to proceed with the paymenttransaction has not been provided (e.g., the device is not armed), thedevice provides an indication requesting authorization to proceed withthe payment transaction. For example, the indication may be a display ofa fingerprint visual indicator (e.g., 710A of FIG. 7C) on the display orthe indication may be producing a haptic alert at the device (or boththe visual indicator and the haptic alert). These indications requestingauthorization to proceed with the payment transaction provide anintuitive user interface to let the user know that the contactlesspayment transaction terminal 2000 is capable of processing (or isattempting to process) a payment transaction using the device.

In some embodiments, the indication requesting authorization to proceedwith the payment transaction includes detecting, by the short-rangecommunication radio, whether the device continues to be in the presenceof the field 2002. In response to detecting that the device does notcontinue to be in the presence of the field, the device displays, on thedisplay, a visual indicator indicating that authentication has failed orhas not been provided). The visual indicator is helpful because the usermay be looking at the device while the device is not in the field 2002.In response to detecting that the device continues to be in the presenceof the field, causing, at the electronic device, a non-visual alert(e.g., haptic or audio alert) indicating that authentication has failed(or has not been provided). The non-visual alert is helpful because theuser may not be looking at the display when the device is in the field2002. In some embodiments, a similar approach is used to indicatesuccess of the authentication. When the device is out of the field, theuser is likely able to easily look at the display, whereas when thedevice is in the field, the user is not likely to be able to easily lookat the display, thus providing a non-visual alert when the device is inthe field provides a more intuitive user interface for the device.

In some embodiments, providing an indication requesting authorization toproceed with the payment transaction includes displaying, on thedisplay, instruction (e.g., prompt user to authenticate usingfingerprint reader, 710A of FIG. 7C) for authorizing to proceed with thepayment transaction. In some embodiments, providing an indicationrequesting authorization to proceed with the payment transactioncomprises causing, at the electronic device, a haptic alert instead of,or in addition to, the instruction for authorizing to proceed with thepayment transaction.

In some embodiments, providing the indication requesting authorizationto proceed with the payment transaction comprises displaying anauthorization request screen on the display of the electronic device,such as illustrated in FIG. 7C. The authorization request screenincludes a graphical representation 704 of the credit card associatedwith the payment account, and the graphical representation 704 includesthe background image of the credit card associated with the paymentaccount. In some embodiments, the graphical representation 704 alsoincludes other information identifying the credit card associated withthe payment account, such as a name of the credit card holder, a creditcard number from the physical credit card (even if the credit cardnumber from the physical credit card is different from the accountnumber linked to the device), and/or an expiration date.

In some embodiments, after detecting the presence of the field 2002generated by the contactless payment transaction terminal whenauthorization to proceed with the payment transaction has not beenprovided (e.g., the user has not provided authorization to the device),the device detects, by the short-range communication radio, that thedevice is no longer in range of the field 2002 generated by thecontactless payment transaction terminal 2000. In response to detectingthat the device is no longer in range of the field 2002 (e.g., the useris not holding the device over the contactless payment transactionterminal 2000), the device displays a plurality of payment cardaffordances (e.g., payment card affordances 704 and 708 of FIG. 7C)associated with different payment accounts. The device receivesauthorization to proceed with the payment transaction for apredetermined period of time with one of the payment accounts (e.g., inresponse to detecting a user input selecting a “pay with this paymentaccount” option in a displayed representation of a payment account).

At FIG. 7C, the device provides an indication that a default paymentcard affordance 704 of the plurality of payment card affordances 704 and708 is selected as a default payment account. The default primaryaccount number associated with the default payment card affordance isselected for use in the payment transaction (e.g., when the user doesnot select a different payment account for use in the paymenttransaction). In some embodiments, different payment accounts areassigned as the default payment account based on current environmentalfactors, such as the current day of month, time of day, and/or location.In some embodiments, different payment accounts are assigned as thedefault card based on the budget available on one or more paymentaccounts. For example, a payment account that has reached a maximumbudget (or has reached a threshold based on the maximum budget) will notbe used as the default payment account.

However, a user can select an alternate payment card affordance (such asone of the plurality of payment card affordances 704 and 708). Thedevice receives the selection (e.g., a finger tap) of the alternatepayment card affordance of the plurality of payment card affordances 704and 708, where the alternate payment card affordance is associated witha respective alternate primary account number. In response to receivingthe selection of the alternate payment card affordance, the deviceselects the respective alternate primary account number for use in thepayment transaction (rather than the default primary account number).

In some embodiments, in accordance with the determination thatauthorization to proceed with the payment transaction has not beenprovided, the device receives authorization (e.g., receiving a passcodefor payment or detecting a fingerprint for payment) to proceed with apayment transaction for a predetermined period of time (e.g., up to 30seconds). For example, the user places the device into the field 2002and is prompted to provide authorization, as discussed above. The userthen removes the device from the field 2002 and provides authorizationusing the fingerprint sensor or a passcode. The authorization is validfor a predetermined period of time (e.g., 30 seconds). If the userplaces the device into field 2002 before the predetermined period oftime has elapsed, the device will proceed with the payment transaction.After the predetermined period of time has elapsed, the device will nolonger have authorization to proceed with the payment transaction(unless the user authorizes the device again), and accordingly thedevice will not proceed with the payment transaction. Thus, the devicedoes not stay authorized indefinitely after receiving authorization toproceed with a payment transaction.

FIGS. 7D-7G illustrate various exemplary user interfaces and techniquesfor receiving authorization to proceed with the payment transaction. Asdiscussed above, in some embodiments, authorization to proceed with thepayment transaction can be provided through the fingerprint sensor 702.At FIG. 7D, the device detects a respective fingerprint on a fingerprintsensor 702 of the electronic device. In response to detecting therespective fingerprint on the fingerprint sensor, the device determinesthat the fingerprint is consistent with an enrolled fingerprint that isenabled to authorize payment transactions. The device displays progressof the determination of whether the respective fingerprint is consistentwith an enrolled fingerprint by at least partially filling in thefingerprint visual indicator 710A, as shown in the partially filledfingerprint visual indicator 710B. In accordance with a determinationthat a respective fingerprint is consistent with the enrolledfingerprint, the device can authorize the payment transaction. Thedevice may also display progress of the payment transaction process byfurther filling in the fingerprint visual indicator 710B. The deviceprovides an indication (e.g., checkmark 730 of FIG. 7K) when the paymenttransaction is completed.

FIG. 7E illustrates an exemplary user interface where authenticationusing the fingerprint sensor has failed. In some embodiments, inaccordance with a determination that the respective fingerprint is notconsistent with the enrolled fingerprint, the device displays, on thedisplay, a visual prompt (712 of FIG. 7E) instructing a user to place afinger on the fingerprint sensor 702.

FIGS. 7E-7F illustrate various exemplary user interfaces to authenticateusing a passcode. In some embodiments, in accordance with adetermination that the respective fingerprint is not consistent with theenrolled fingerprint, the device displays, on the display, an affordance714 for receiving authorization to proceed with the payment transactionusing a payment passcode (rather than the fingerprint sensor). Thedevice also indicates to the user that authentication has failed by, forexample, providing visual prompt 712. If the device receives selectionof the affordance 714 for receiving authorization, the device displays akeypad 740 for receiving a payment passcode entry, such as illustratedin FIG. 7L. In FIG. 7F, the user attempts to authenticate again usingthe fingerprint sensor 702. The device displays progress of thedetermination of whether the respective fingerprint is consistent withan enrolled fingerprint by at least partially filling in the fingerprintvisual indicator, as shown in the partially filled fingerprint visualindicator 710B of FIG. 7F. If the device determines that the respectivefingerprint is consistent with an enrolled fingerprint, the devicedisplay the completely filled fingerprint visual indicator 710C of FIG.7G.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint,the device plays, at the electronic device, a failure audio alertthrough a speaker. The failure audio alert indicates that authorizationto proceed with the payment transaction has not been provided. Providingan audio notification to the user of the device of the status (or state)of the technique is helpful for the user to understand whetheradditional input is required.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint,the device causes a failure haptic alert indicating that authorizationto proceed with the payment transaction has not been provided. Thehaptic feedback is particularly helpful to the user if the user hasplaced the device into the field 2002 and is not looking at the display.

FIG. 7F illustrates an exemplary user interface for authentication usingthe fingerprint sensor after one or more failed attempts atauthenticating using the fingerprint sensor. In some embodiments, theelectronic device determines whether a predetermined number of attemptsto receive authorization to proceed with the payment transaction usingthe fingerprint sensor has been reached. In accordance with adetermination that the predetermined number of attempts to receiveauthorization has been reached, the device requires authorization usinga payment passcode to proceed with the payment transaction, such as inthe user interface illustrated in FIG. 7L. For example, thepredetermined number of attempts is three. Thus, after the third failedattempt to authorize using the fingerprint sensor, the device requiresauthorization using a payment passcode to proceed with the paymenttransaction.

FIGS. 7M-7O illustrate various exemplary user interfaces for receivingauthorization to proceed with the payment transaction. As discussedabove, authorization to proceed with the payment transaction can beprovided through receiving a payment passcode. In some embodiments, thedevice receives a payment passcode at the electronic device. The devicedetermines that the payment passcode is consistent with an enrolledpasscode that is enabled to authorize payment transactions. In responseto determining that the payment passcode is consistent with the enrolledpasscode (e.g., a passcode programmed by the user for unlocking thedevice or for making payments), the device authorizes the paymenttransaction. For example, authorization can be received using a paymentpasscode when authorization using the fingerprint sensor 702 has failed.If the electronic device does not support authorization using thefingerprint sensor 702 (e.g., the feature has been disabled or thedevice does not have a fingerprint sensor 702), the user interface ofFIG. 7M may be displayed instead of the user interface of FIG. 7C. AtFIG. 7N, the device receives selection of the payment passcodeaffordance 732. In response, the device displays keypad 740 forreceiving a payment passcode entry, such as illustrated in FIG. 7O.

In some embodiments, the predetermined period of time is based on acurrent location of the electronic device. For example, when the devicedetermines that the current location is at a department store, thepredetermined period of time may be set to 15 seconds. In anotherexample, when the device determines that the current location is aconcert or theater venue, the predetermined period of time may be set to45 seconds. This may, for example, help to accommodate delays such asstanding in line or making a purchase decision. Having a predeterminedperiod of time that is based on the location may also help limit fraud.

In some embodiments, the predetermined period of time is based on acredit score associated with the payment account. For example, thepredetermined period of time may be based on creditworthiness. In oneexample, the predetermined period of time may be set to 30 seconds whenthe credit score associated with the payment account is above athreshold, indicating good credit. In another example, the predeterminedperiod of time may be set to 15 seconds when the credit score associatedwith the payment account is below a threshold, indicating not goodcredit (e.g., poor credit). For example, a predetermined period of timethat is based on a credit score may help limit fraud.

In some embodiments, the predetermined period of time isuser-configurable. For example, a user may decide that a longerpredetermined period of time may be helpful in proceeding with paymenttransactions. Thus, the user can increase the predetermined period oftime to value, such as 60 seconds, that is higher than the defaultvalue. For example, a predetermined period of time that is userconfigurable may help limit fraud.

FIGS. 7H-7J illustrate various exemplary user interfaces for indicatingthat authorization to proceed with a payment transaction has beenprovided. In some embodiments, in response to receiving authorization toproceed with the payment transaction, (e.g., through a passcode or thefingerprint sensor 702), the device displays a graphical indication720A-720C that authorization to proceed has been provided. In someembodiments, the graphical indication includes an indication to placethe device in the field (e.g., an animated icon that shows a devicemoving to indicate that the device needs to be moved to be placed inrange of the field 2002). For example, graphical indication 720A-720C isan animation illustrating an electronic device, such as a cellularphone, starting at a substantially vertical position (720A, FIG. 7H),being bent down (backwards) from the substantially vertical position(720B, FIG. 7I), and returning to the substantially vertical position(720C, FIG. 7J). This indicates to the user that authorization toproceed with the payment transaction has been provided to the electronicdevice, and that the user should place the electronic device into thefield 2002 to proceed with the payment transaction.

FIG. 7K illustrates an exemplary user interface for indicating that thepayment transaction was completed. In some embodiments, in response toreceiving authorization to proceed with the payment transaction, thedevice proceeds with the payment transaction (e.g., processes thepayment transaction using the NFC-enabled contactless paymenttransaction terminal 2000 when the device is within range of the field2002 and the authorization has not expired). In some examples, thedevice provides an indication (e.g., checkmark 730 of FIG. 7K) when thepayment transaction is completed.

FIGS. 8A-8B are flow diagrams illustrating a method 800 for proceedingwith a payment transaction using a short-range communication radio(e.g., an NFC radio) in accordance with some embodiments. It should beappreciated that other communications standards and techniques may beused. Method 800 is performed at a device (e.g., device 300, FIG. 3, orportable multifunction device 100, FIG. 1) with a display and ashort-range communication radio. Some operations in method 800 may becombined, the order of some operations may be changed, and someoperations may be omitted.

As described below, method 800 provides an intuitive way to proceed witha payment transaction using a short-range communication radio. Themethod reduces the cognitive burden on a user when making a paymenttransaction, thereby creating a more efficient human-machine interface.For battery-operated computing devices, enabling a user to make apayment transaction faster and more efficiently conserves power andincreases the time between battery charges.

Multifunction device 100 (and device 300) may include near fieldcommunications circuitry. Accordingly, device 100 can wirelesslycommunicate with external equipment, such as NFC-enabled contactlesspayment transaction terminal 2000, using near field communications. Thecontactless payment transaction terminal 2000 may be part of a paymentsystem (e.g., check register) installed in a retail store for processingpayment transactions, such as purchases of products and services. Forexample, the near field communications circuitry in device 100 mayinclude a near field transmitter and a near field receiver. Near fieldcommunications for device 100 may be supported using capacitive couplingnear field communications structures and/or inductive coupling nearfield communications structures. In near field communicationstechniques, wireless signals are typically conveyed, for example, overdistances of 1 m or less, 100 cm or less, 10 cm or less, or 1 cm orless, and are not conveyed over longer distances.

At block 802, in some embodiments, the electronic device receivesauthorization (e.g., from the user, as described in detail below) toproceed with a payment transaction prior to detecting presence of afield (e.g., an NFC compliant RF field 2002 of FIG. 7A) generated by thecontactless payment transaction terminal (e.g., 2000 of FIG. 7A). Theauthorization is only valid for a predetermined period of time (e.g., upto 30 seconds). If the user places the device into the field afterreceiving authorization and before the predetermined period of time haselapsed, the device will proceed with the payment transaction (e.g., apayment of funds being solicited by the contactless payment transactionterminal 2000 of FIG. 7A). After the predetermined period of time haselapsed, the device will no longer have authorization to proceed withthe payment transaction (unless the user authorizes the device again),and accordingly the device will not proceed with the paymenttransaction, even if placed within range of the field. Thus, the devicedoes not stay authorized indefinitely after receiving authorization toproceed with a payment transaction. In some embodiments, the device maynot receive authorization to proceed with the payment transaction priorto detecting presence of the field generated by the contactless paymenttransaction terminal.

At block 804, the electronic device detects, by the short-rangecommunication radio of the electronic device presence of the field(e.g., the NFC compliant RF field 2002 of FIG. 7B) generated by thecontactless payment transaction terminal (e.g., an NFC-compliant paymenttransaction terminal 2000 of FIG. 7B).

At block 806, in response to detecting presence of the field generatedby the contactless payment transaction terminal, the device determineswhether authorization to proceed with a payment transaction is provided.For example, the device determines whether the device has beenpre-authorized by the user (e.g., prior to the device detecting thefield) for proceeding with payment transactions or whether the user iscurrently authorizing the device to proceed with the payment transaction(e.g., the user has placed a finger on a fingerprint sensor forauthorization).

At block 808, in some embodiments, while the device is within range ofthe field generated by the contactless payment transaction terminal, thedevice detects a respective fingerprint on a fingerprint sensor of theelectronic device. In response to detecting the respective fingerprinton the fingerprint sensor, the device determines whether the fingerprintis consistent with an enrolled fingerprint that is enabled to authorizepayment transactions. In accordance with a determination that arespective fingerprint is consistent with the enrolled fingerprint, thedevice authorizes the payment transaction. For example, a user placestheir finger on the fingerprint sensor of the device (e.g., withoutturning on the display of the device or opening any particularapplication) and then places the device into the field. When the devicedetects the field, the device reads the fingerprint and determines thatthe user has provided authorization to make a payment using the device.In accordance with a determination that the respective fingerprint isnot consistent with the enrolled fingerprint, the device forgoesauthorization of the payment transaction. In other words, the device isnot authorized to proceed with the payment transaction, meaningauthorization is still required to proceed with the payment transaction.

In some embodiments, the user interface of the electronic device islocked when presence of the field generated is detected and the displayof the electronic device is off when presence of the field generated isdetected. In response to detecting the presence of the field generatedby the contactless payment transaction terminal, the device turns thedisplay on.

At block 810, in some embodiments, in response to detecting presence ofthe field generated by the contactless payment transaction terminal, thedevice displays an electronic wallet (e.g., as illustrated in FIG. 7Cand/or if the device is placed in range of the field while the device isunlocked). The electronic wallet includes a plurality of payment cardaffordances (such as payment card affordances 704 and 708 of FIG. 7C).

At block 812, in accordance with a determination that authorization toproceed with the payment transaction has been provided (e.g., the userprovided authorization prior to entering the field or the user providesauthorization while the device is in the field), the device proceedswith the payment transaction with the contactless payment transactionterminal (e.g., transmitting an identifier such as a PAN to thecontactless payment transaction terminal for use in completing thepayment transaction).

In some embodiments, proceeding with the payment transaction with thecontactless payment transaction terminal 2002 comprises using a linkedpayment account (e.g., a payment account linked to the electronic deviceand stored in an electronic wallet) to complete the payment transaction.In some embodiments, proceeding with the payment transaction with thecontactless payment transaction terminal comprises using a primaryaccount number for use in the payment transaction (e.g., using thecredit account to make the purchase) to complete the paymenttransaction, where the primary account number is stored on theelectronic device.

At block 814, in some embodiments, in accordance with the determinationthat authorization to proceed with the payment transaction has beenprovided, the device determines whether the payment transaction issuccessfully completed. In response to determining the paymenttransaction is successfully completed, the device plays, at theelectronic device, a success audio alert. The success audio alertindicates that the payment transaction is successfully completed. Insome embodiments, the success audio alert is different than a failureaudio alert.

Similarly, providing non-audio notifications to the user of the deviceis helpful for the user to understand whether additional input isrequired. At block 814, in some embodiments, in accordance with thedetermination that authorization to proceed with the payment transactionhas been provided (e.g., the device is armed), the device determineswhether the payment transaction is successfully completed. In responseto determining the payment transaction is successfully completed, thedevice causes a success haptic alert indicating that the paymenttransaction is successfully completed. In one example, the successhaptic alert is different than a failure haptic alert. For example, thefailure haptic alert is longer in duration and more intense than thesuccess haptic alert.

At block 816, in accordance with a determination that authorization toproceed with the payment transaction has not been provided (e.g., thedevice is not armed), and at block 818 the device provides an indicationrequesting authorization to proceed with the payment transaction. Forexample, the indication may be display of a fingerprint visual indicator(e.g., 710A of FIG. 7C) on the display or the indication may beproducing a haptic alert at the device (or both the visual indicator andthe haptic alert). These indications requesting authorization to proceedwith the payment transaction provide an intuitive user interface to letthe user know that the contactless payment transaction terminal 2000 iscapable of processing (or is attempting to process) a paymenttransaction using the device.

In some embodiments, the indication requesting authorization to proceedwith the payment transaction includes detecting, by the short-rangecommunication radio, whether the device continues to be in the presenceof the field 2002. In response to detecting that the device does notcontinue to be in the presence of the field, the device displays, on thedisplay, a visual indicator indicating that authentication has failed orhas not been provided). The visual indicator is helpful because the usermay be looking at the device while the device is not in the field 2002.In response to detecting that the device continues to be in the presenceof the field, causing, at the electronic device, a non-visual alert(e.g., haptic or audio alert) indicating that authentication has failed(or has not been provided). The non-visual alert is helpful because theuser may not be looking at the display when the device is in the field2002. In some embodiments, a similar approach is used to indicatesuccess of the authentication. When the device is out of the field, theuser is likely able to easily look at the display, whereas when thedevice is in the field, the user is not likely to be able to easily lookat the display, thus providing a non-visual alert when the device is inthe field provides a more intuitive user interface for the device.

In some embodiments, providing an indication requesting authorization toproceed with the payment transaction includes displaying, on thedisplay, instruction (e.g., prompt user to authenticate usingfingerprint reader, 710A of FIG. 7C) for authorizing to proceed with thepayment transaction. In some embodiments, providing an indicationrequesting authorization to proceed with the payment transactioncomprises causing, at the electronic device, a haptic alert instead of,or in addition to, the instruction for authorizing to proceed with thepayment transaction.

In some embodiments, providing the indication requesting authorizationto proceed with the payment transaction comprises displaying anauthorization request screen on the display of the electronic device.The authorization request screen includes a graphical representation(e.g., 704 of FIG. 7C) of the credit card associated with the paymentaccount, and the graphical representation (e.g., 704 of FIG. 7C)includes the background image of the credit card associated with thepayment account. In some embodiments, the graphical representation(e.g., 704 of FIG. 7C) also includes other information identifying thecredit card associated with the payment account, such as a name of thecredit card holder, a credit card number from the physical credit card(even if the credit card number from the physical credit card isdifferent from the account number linked to the device), and/or anexpiration date.

At block 820, in some embodiments, after detecting the presence of thefield generated by the contactless payment transaction terminal whenauthorization to proceed with the payment transaction has not beenprovided (e.g., the user has not provided authorization to the device),the device detects, by the short-range communication radio, that thedevice is no longer in range of the field generated by the contactlesspayment transaction terminal. In response to detecting that the deviceis no longer in range of the field (e.g., the user is not holding thedevice over the contactless payment transaction terminal), the devicedisplays a plurality of payment card affordances (e.g., payment cardaffordances 704 and 708 of FIG. 7C) associated with different paymentaccounts. The device receives authorization to proceed with the paymenttransaction for a predetermined period of time with one of the paymentaccounts (e.g., in response to detecting a user input selecting a “paywith this payment account” option in a displayed representation of apayment account).

At block 822, in some embodiments, the device provides an indicationthat a default payment card affordance (e.g., 704 of FIG. 7C) of theplurality of payment card affordances (e.g., 704 and 708 of FIG. 7C) isselected as a default payment account. The default primary accountnumber associated with the default payment card affordance is selectedfor use in the payment transaction (e.g., when the user does not selecta different payment account for use in the payment transaction). In someembodiments, different payment accounts are assigned as the defaultpayment account based on current environmental factors, such as thecurrent day of month, time of day, and/or location. In some embodiments,different payment accounts are assigned as the default card based on thebudget available on one or more payment accounts. For example, a paymentaccount that has reached a maximum budget (or has reached a thresholdbased on the maximum budget) will not be used as the default paymentaccount.

At block 824, in some embodiments, the device receives the selection(e.g., a finger tap) of the alternate payment card affordance of theplurality of payment card affordances (e.g., 704 and 708 of FIG. 7C),where the alternate payment card affordance is associated with arespective alternate primary account number. In response to receivingthe selection of the alternate payment card affordance, the deviceselects the respective alternate primary account number for use in thepayment transaction (rather than the default primary account number).

At block 826, in some embodiments, in accordance with the determinationthat authorization to proceed with the payment transaction has not beenprovided, the device receives authorization (e.g., receiving a passcodefor payment or detecting a fingerprint for payment) to proceed with apayment transaction for a predetermined period of time (e.g., up to 30seconds). For example, the user places the device into the field and isprompted to provide authorization, as discussed above. The user thenremoves the device from the field and provides authorization using thefingerprint sensor or a passcode. The authorization is valid for apredetermined period of time (e.g., 30 seconds). If the user places thedevice into the field before the predetermined period of time haselapsed, the device will proceed with the payment transaction. After thepredetermined period of time has elapsed, the device will no longer haveauthorization to proceed with the payment transaction (unless the userauthorizes the device again), and accordingly the device will notproceed with the payment transaction. Thus, the device does not stayauthorized indefinitely after receiving authorization to proceed with apayment transaction.

As discussed above, in some embodiments, authorization to proceed withthe payment transaction can be provided through a fingerprint sensor(e.g., 702 of FIG. 7D). At block 830, the device detects a respectivefingerprint on a fingerprint sensor of the electronic device. Inresponse to detecting the respective fingerprint on the fingerprintsensor, the device determines that the fingerprint is consistent with anenrolled fingerprint that is enabled to authorize payment transactions.In accordance with a determination that a respective fingerprint isconsistent with the enrolled fingerprint, the device authorizes thepayment transaction.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint(e.g., authentication using the fingerprint sensor has failed), thedevice displays, on the display, a visual prompt (e.g., 712 of FIG. 7E)instructing a user to place a finger on the fingerprint sensor.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint,the device displays, on the display, an affordance (e.g., 714 of FIG.7E) for receiving authorization to proceed with the payment transactionusing a payment passcode (rather than the fingerprint sensor). Thedevice also indicates to the user that authentication has failed by, forexample, providing visual prompt (e.g., 712 of FIG. 7E). If the devicereceives selection of the affordance for receiving authorization, thedevice displays a keypad (e.g., 740 of FIG. 7L) for receiving a paymentpasscode entry.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint,the device plays, at the electronic device, a failure audio alertthrough a speaker. The failure audio alert indicates that authorizationto proceed with the payment transaction has not been provided. Providingan audio notification to the user of the device of the status (or state)of the technique is helpful for the user to understand whetheradditional input is required.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint,the device causes a failure haptic alert indicating that authorizationto proceed with the payment transaction has not been provided. Thehaptic feedback is particularly helpful to the user if the user hasplaced the device into the field and is not looking at the display.

In some embodiments, the electronic device determines whether apredetermined number of attempts to receive authorization to proceedwith the payment transaction using the fingerprint sensor has beenreached. In accordance with a determination that the predeterminednumber of attempts to receive authorization has been reached, the devicerequires authorization using a payment passcode to proceed with thepayment transaction (e.g., the user interface of FIG. 7L). For example,the predetermined number of attempts is three. Thus, after the thirdfailed attempt to authorize using the fingerprint sensor, the devicerequires authorization using a payment passcode to proceed with thepayment transaction.

As discussed above, authorization to proceed with the paymenttransaction can be provided through receiving a payment passcode. Insome embodiments, the device receives a payment passcode at theelectronic device. The device determines that the payment passcode isconsistent with an enrolled passcode that is enabled to authorizepayment transactions. In response to determining that the paymentpasscode is consistent with the enrolled passcode (e.g., a passcodeprogrammed by the user for unlocking the device or for making payments),the device authorizes the payment transaction. For example,authorization can be received using a payment passcode whenauthorization using the fingerprint sensor has failed.

In some embodiments, the predetermined period of time is based on acurrent location of the electronic device. For example, when the devicedetermines that the current location is at a department store, thepredetermined period of time may be set to 15 seconds. In anotherexample, when the device determines that the current location is aconcert or theater venue, the predetermined period of time may be set to45 seconds. This may, for example, help to accommodate delays such asstanding in line or making a purchase decision. Having a predeterminedperiod of time that is based on the location may also help limit fraud.

In some embodiments, the predetermined period of time is based on acredit score associated with the payment account. For example, thepredetermined period of time may be based on creditworthiness. In oneexample, the predetermined period of time may be set to 30 seconds whenthe credit score associated with the payment account is above athreshold, indicating good credit. In another example, the predeterminedperiod of time may be set to 15 seconds when the credit score associatedwith the payment account is below a threshold, indicating not goodcredit (e.g., poor credit). For example, a predetermined period of timethat is based on a credit score may help limit fraud.

In some embodiments, the predetermined period of time isuser-configurable. For example, a user may decide that a longerpredetermined period of time may be helpful in proceeding with paymenttransactions. Thus, the user can increase the predetermined period oftime to value, such as 60 seconds, that is higher than the defaultvalue. For example, a predetermined period of time that isuser-configurable may help limit fraud.

At block 832, in some embodiments, in response to receivingauthorization to proceed with the payment transaction, (e.g., through apasscode or a fingerprint sensor), the device displays a graphicalindication (e.g., 720A-720C of FIGS. 7H-7J) that authorization toproceed has been provided. In some embodiments, the graphical indicationincludes an indication to place the device in the field (e.g., ananimated icon that shows a device moving to indicate that the deviceneeds to be moved to be placed in range of the field). This indicates tothe user that authorization to proceed with the payment transaction hasbeen provided to the electronic device, and that the user should placethe electronic device into the field to proceed with the paymenttransaction.

At block 834, in some embodiments, in response to receivingauthorization to proceed with the payment transaction, the deviceproceeds with the payment transaction (e.g., processes the paymenttransaction using the NFC-enabled contactless payment transactionterminal 2000 when the device is within range of the field 2002 and theauthorization has not expired).

Note that details of the processes described above with respect tomethod 800 (e.g., FIGS. 8A-8B and 7A-7O) are also applicable in ananalogous manner to the methods described below and above. For example,methods 600, 1000, 1200, 1400, 1600, 1800, 2000, and 2200 may includeone or more of the characteristics of the various methods describedabove with reference to method 800. For brevity, these details are notrepeated below.

The operations described above with reference to the figures may beimplemented by components depicted in FIGS. 1A-1B. For example, displayoperations, detection operations, and determination operations may beimplemented by event sorter 170, event recognizer 180, and event handler190. Event monitor 171 in event sorter 170 detects a contact ontouch-sensitive display 112, and event dispatcher module 174 deliversthe event information to application 136-1. A respective eventrecognizer 180 of application 136-1 compares the event information torespective event definitions 186, and determines whether a first contactat a first location on the touch-sensitive surface corresponds to apredefined event or sub-event, such as selection of an object on a userinterface. When a respective predefined event or sub-event is detected,event recognizer 180 activates an event handler 190 associated with thedetection of the event or sub-event. Event handler 190 may utilize orcall data updater 176 or object updater 177 to update the applicationinternal state 192. In some embodiments, event handler 190 accesses arespective GUI updater 178 to update what is displayed by theapplication. Similarly, it would be clear to a person having ordinaryskill in the art how other processes can be implemented based on thecomponents depicted in FIGS. 1A-1B.

FIGS. 9A-9H illustrate exemplary user interfaces for displayingtransaction information of a payment account in accordance with someembodiments. The user interfaces in these figures are used to illustratethe processes described below, including the process in FIGS. 10A-10B.

FIGS. 9A-9C illustrate exemplary user interfaces for displaying detailsof a most recent payment transaction in accordance with someembodiments. FIG. 9A illustrates an exemplary user interface of anelectronic device 100, including an electronic wallet. The electronicwallet includes a respective representation of a payment account (e.g.,a revolving credit account held with a financial institution). Therespective representation of the payment account (e.g., a displayshowing the front of a credit card that is associated with the paymentaccount) includes first transaction information 950 (e.g., date, time,location of the transaction, name of retailer, charge amount) for afirst payment transaction associated with the payment account. Forexample, the first payment transaction may be the most recenttransaction associated with the payment account. The first transactioninformation 950 includes, for example, the date 912, time, and/orlocation of the first payment transaction. The first transactioninformation 950 may also include the name of the retailer 910 associatedwith the first payment transaction and an amount charged 914 for thefirst payment transaction. In some embodiments, the first paymenttransaction was completed using the electronic device, such as throughan NFC payment transaction using the electronic device (e.g., asillustrated and described in FIGS. 7A-7O and FIGS. 8A-8B) or a paymenttransaction using an application or website accessed on the electronicdevice (e.g., as illustrated and described in FIGS. 11A-11N and FIGS.12A-12C). In some embodiments, the first payment transaction wascompleted using a physical credit card associated with the paymentaccount (e.g., by swiping the credit card at a payment terminal at aretail store). By displaying the first transaction information 950, aviewer of the electronic wallet can quickly and efficiently appreciatethe details of the most recent transaction associated with the paymentaccount.

FIG. 9B illustrates an exemplary user interface for displayinginformation about a subsequent payment transaction. The electronicdevice detects a second payment transaction associated with the paymentaccount using the electronic device. For example, the paymenttransaction may be an NFC payment transaction using the electronicdevice (e.g., as illustrated and described in FIGS. 7A-7O and FIGS.8A-8B) or a payment transaction using an application or website accessedon the electronic device (e.g., as illustrated and described in FIGS.11A-11N and FIGS. 12A-12C). In one example, the payment account islinked to the electronic device. At block 1006, in response to detectingthe second payment transaction, and prior to receiving information aboutthe second payment transaction from a financial institution involved inthe second transaction (e.g., the merchant or financial institution thatprocessed the payment transaction), the device displays at block 1008second transaction information 960 (e.g., date, time, location of thesecond payment transaction) for the second payment transaction. Thesecond transaction information 960 is based on information locallyavailable to the electronic device. For example, information locallyavailable to the electronic device comprises one or more of a date 922of the second payment transaction, a time 922 of the second paymenttransaction, or a location 924 of the electronic device when the secondpayment transaction was detected. In one example, the second transactioninformation 960 is based exclusively on information locally available tothe electronic device prior to receiving information about the secondpayment transaction from a financial institution involved in the secondtransaction.

In some embodiments, display of the second transaction information 960(e.g., date, time, location of the second payment transaction) for thesecond payment transaction replaces the display of the first transactioninformation 950 (e.g., date, time, location of the transaction, name ofretailer, charge amount of the first payment transaction). In otherwords, displaying the second transaction information 960 for the secondpayment transaction comprises replacing display of the first transactioninformation 950 with display of the second transaction information 960.

FIG. 9C illustrates updating the second transaction information 960. Insome embodiments, the electronic device receives first additionalinformation 926 (e.g., the amount of the second payment transaction)about the second payment transaction from an intermediary institutioninvolved in the second transaction. The intermediary institution may be,for example, the institution that provides the operating system of theelectronic device or provides the electronic wallet software applicationof the electronic device. In some embodiments, the first additionalinformation 926 includes a monetary amount of the second paymenttransaction (e.g., $425.00). In response to receiving the firstadditional information 926 about the second payment transaction from theintermediary institution involved in the second transaction, theelectronic device updates the second transaction information 960 for thesecond payment transaction to include the first additional information926 about the second payment transaction. Thus, the user interfaceallows the user to easily and efficiently determine the date, time,location, and/or amount of the most recent detected payment transactionassociated with the payment account (e.g., the second paymenttransaction).

FIG. 9D illustrates further updating the second transaction information960. In some embodiments, the electronic device receives secondadditional information (e.g., dollar amount, name of merchant 920) aboutthe second payment transaction from the financial institution involvedin the second transaction (e.g., the bank or the merchant). In responseto receiving the second additional information 920 about the secondpayment transaction from the financial institution involved in thesecond transaction, the device updates display of the second transactioninformation 920 for the second payment transaction to include the secondadditional information 920 about the second payment transaction. In someembodiments, the second transaction information is updated when theelectronic wallet is refreshed (e.g., by reloading the electronic walletapplication or by reopening the electronic wallet application after ithas been closed). In some embodiments, the second additional information920 about the second payment transaction comprises the name of theretailer receiving payment as a result of the second paymenttransaction.

In some embodiments, the electronic device displays an available creditamount (e.g., how much more can be charged to the account before acredit limit for the account will be reached, or how much more can becharged to the account before a user-specified budget for the account isreached) on the respective representation of the payment account. Forexample, the available credit amount indicates the amount of creditavailable on the payment account based on a credit limit of the paymentaccount. Displaying the available credit amount allows the user toefficiently determine how much more money can be spent using the paymentaccount.

FIG. 9E illustrates an exemplary user interface for displaying a messagefrom the financial institution. In some embodiments, the respectiverepresentation of the payment account includes a message from thefinancial institution. The electronic device receives a textual message916 from the financial institution and displays the textual message fromthe financial institution on the respective representation of thepayment account. For example, the message may be an offer for the useror a notification relating to the payment account. The electronic devicereceives selection of the displayed textual message (e.g., useractivates the textual message by tapping on the message), and, inresponse to receiving selection of the displayed textual message, thedevice displays a particular application (e.g., the financialinstitution's banking application) associated with the financialinstitution. For example, the user taps on the textual message 916 andthe electronic device displays the particular software applicationrelated to the financial institution.

FIGS. 9F-9G illustrate exemplary user interfaces for displaying thedetails of transactions of a payment account. In one embodiment, theelectronic device displays an account detail affordance 906 on therespective representation of the payment account. The electronic devicereceives selection of the account detail affordance 906 FIG. 9F, and, inresponse to receiving selection of the transactions detail affordance906, the electronic device substitutes display of the respectiverepresentation of the payment account for display of transactionsdetails 930 (e.g., the device displays the back of the representation ofthe payment account to reveal payment history and additional details) ofthe payment account, as illustrated in FIG. 9G. The transactions details930 include the first transaction information 950 and the secondtransaction information 960. For example, the user taps on transactionsdetail affordance 906 and the electronic device displays a historicallist of transactions for the payment account.

In some embodiments, the transactions details 930 includes amore-transactions affordance 954. The electronic device receivesselection of the more-transactions affordance 954, and, in response toreceiving selection of the more-transactions affordance, the devicedisplays a third transaction information associated with a third paymenttransaction associated with the payment account as part of the displayedtransactions details 930 (e.g., the device displays more (or older)transactions for the payment account).

In some embodiments, the transactions details 930 includes a remove-cardaffordance 958. The electronic device receives selection of theremove-card affordance, and, in response to receiving selection of theremove-card affordance 958, the electronic device displays aconfirmation request for removing the respective representation of thepayment account from the electronic wallet. The device receives aconfirmation to remove the respective representation of the paymentaccount from the electronic wallet (e.g., the user activates anaffordance confirming that the payment account should be removed). Theelectronic device removes the respective representation of the paymentaccount from the electronic wallet (e.g., after receiving theconfirmation). Thus, a user can initiate the process to remove the linkbetween the electronic device and a payment account by tapping on theremove-card affordance 958.

FIGS. 9G-9H illustrate exemplary user interfaces for accessing aparticular application associated with the payment account. In someembodiments, transactions details 930 includes an open-applicationaffordance 934 for accessing a particular application or adownload-application affordance for downloading and installing theparticular application. The electronic device determines whether aparticular application (e.g., a software application associated with thepayment account, such as a banking application) for accessing details ofthe associated payment account is installed on the electronic device. Inaccordance with a determination that the particular application isinstalled, the electronic device displays open-application affordance934 for accessing (such as starting or displaying) the particularapplication. In some embodiments, in accordance with a determinationthat the particular application is not installed, the electronic devicedisplays a download-application affordance (e.g. in place of theopen-application affordance 934) for downloading and installing theparticular application on the electronic device. In some embodiments,the electronic device receives a selection of the open-applicationaffordance 934 (e.g., a finger tap on the open-application affordance934), and, in response to receiving selection of the open-applicationaffordance 934, the electronic device completely replaces display of thetransactions details 930 with display of the particular application, asillustrated in FIG. 9H. For example, if a user taps the open-applicationaffordance 934, the particular application is displayed. If a user tapsthe download-application affordance, the particular application isdownloaded or a user interface for downloading the particularapplication is displayed.

FIGS. 9G-9H also illustrate exemplary user interfaces for accessing aparticular application associated with the payment account for viewingdetails of a particular payment transaction. In one embodiment, theelectronic device receives selection of the first transactioninformation 950 of the displayed transactions details 930, and, inresponse to receiving selection of the first transaction information950, the electronic device completely replaces display of thetransactions details 930 with display of the particular application 970,as shown in FIG. 9H. The display of the particular application 970includes details 972 about the first payment transaction associated withthe payment account.

In some embodiments, the displayed electronic wallet includes display ofa first stack of card objects and a second stack of card objects, thefirst stack of card objects visually separated from the second stack ofcard objects. The first stack of card objects comprises the respectiverepresentation of the payment account and a second respectiverepresentation of a second payment account. The second stack of cardobjects comprises a membership card object associated with anon-financial institution (e.g., grocery store membership cards, gymmembership cards, coffee store discount cards).

FIGS. 10A-10B are flow diagrams illustrating method 1000 for displayingtransaction information of a payment account in accordance with someembodiments. Method 1000 is performed at a device (e.g., device 300,FIG. 3, or portable multifunction device 100, FIG. 1) with a display.Some operations in method 1000 may be combined, the order of someoperations may be changed, and some operations may be omitted.

As described below, method 1000 provides an intuitive way for displayingtransaction information of a payment account. The method reduces thecognitive burden on a user when accessing the transaction information,thereby creating a more efficient human-machine interface. Forbattery-operated computing devices, enabling a user access transactioninformation faster and more efficiently conserves power and increasesthe time between battery charges.

At block 1002, the electronic device displays an electronic walletcomprising a respective representation of a payment account (e.g., arevolving credit account held with a financial institution). Therespective representation of the payment account (e.g., a displayshowing the front of a credit card that is associated with the paymentaccount) includes first transaction information (e.g., 950 of FIG. 9A; adate, time, location of the transaction, name of retailer, chargeamount) for a first payment transaction associated with the paymentaccount. For example, the first payment transaction may be the mostrecent transaction associated with the payment account. The firsttransaction information (e.g., 950 of FIG. 9A) includes, for example,the date (e.g., 912 of FIG. 9A), time, and/or location of the firstpayment transaction. The first transaction information may also includethe name of the retailer (e.g., 910 of FIG. 9A) associated with thefirst payment transaction and an amount charged (e.g., 914 of FIG. 9A)for the first payment transaction. In some embodiments, the firstpayment transaction was completed using the electronic device, such asthrough an NFC payment transaction using the electronic device (e.g., asillustrated and described in FIGS. 7A-7O and FIGS. 8A-8B) or a paymenttransaction using an application or website accessed on the electronicdevice (e.g., as illustrated and described in FIGS. 11A-11N and FIGS.12A-12C). In some embodiments, the first payment transaction wascompleted using a physical credit card associated with the paymentaccount (e.g., by swiping the credit card at a payment terminal at aretail store). By displaying the first transaction information, a viewerof the electronic wallet can quickly and efficiently appreciate thedetails of the most recent transaction associated with the paymentaccount.

At block 1004, the electronic device detects a second paymenttransaction associated with the payment account using the electronicdevice. For example, the payment transaction may be an NFC paymenttransaction using the electronic device (e.g., as illustrated anddescribed in FIGS. 7A-7O and FIGS. 8A-8B) or a payment transaction usingan application or website accessed on the electronic device (e.g., asillustrated and described in FIGS. 11A-11N and FIGS. 12A-12C). In oneexample, the payment account is linked to the electronic device.

At block 1006, in response to detecting the second payment transaction,and prior to receiving information about the second payment transactionfrom a financial institution involved in the second transaction (e.g.,the merchant or financial institution that processed the paymenttransaction), the device displays second transaction information (e.g.,960 of FIG. 9B; a date, time, location of the second paymenttransaction) for the second payment transaction. The second transactioninformation is based on information locally available to the electronicdevice. For example, information locally available to the electronicdevice comprises one or more of a date of the second paymenttransaction, a time of the second payment transaction, or a location ofthe electronic device when the second payment transaction was detected.In one example, the second transaction information is based exclusivelyon information locally available to the electronic device prior toreceiving information about the second payment transaction from afinancial institution involved in the second transaction.

At block 1010, in some embodiments, display of the second transactioninformation (e.g., date, time, location of the second paymenttransaction) for the second payment transaction replaces the display ofthe first transaction information (e.g., date, time, location of thetransaction, name of retailer, charge amount of the first paymenttransaction). In other words, displaying the second transactioninformation (e.g., 960 of FIG. 9B) for the second payment transactioncomprises replacing display of the first transaction information (e.g.,950 of FIG. 9A) with display of the second transaction information.

At block 1012, in some embodiments, the electronic device receives firstadditional information (e.g., 926 of FIG. 9C) the amount of the secondpayment transaction) about the second payment transaction from anintermediary institution involved in the second transaction. Theintermediary institution may be, for example, the institution thatprovides the operating system of the electronic device or provides theelectronic wallet software application of the electronic device. In someembodiments, the first additional information (e.g., 926 of FIG. 9C)includes a monetary amount of the second payment transaction (e.g.,$425.00). In response to receiving the first additional informationabout the second payment transaction from the intermediary institutioninvolved in the second transaction, the electronic device updates thesecond transaction information (e.g., 960 of FIG. 9C) for the secondpayment transaction to include the first additional information aboutthe second payment transaction. Thus, the user interface allows the userto easily and efficiently determine the date, time, location, and/oramount of the most recent detected payment transaction associated withthe payment account (e.g., the second payment transaction).

At block 1014, in some embodiments, the electronic device receivessecond additional information (e.g., dollar amount, name of merchant 920of FIG. 9D) about the second payment transaction from the financialinstitution involved in the second transaction (e.g., the bank or themerchant). In response to receiving the second additional information(e.g., 920 of FIG. 9D) about the second payment transaction from thefinancial institution involved in the second transaction, the deviceupdates display of the second transaction information for the secondpayment transaction to include the second additional information aboutthe second payment transaction. In some embodiments, the secondtransaction information is updated when the electronic wallet isrefreshed (e.g., by reloading the electronic wallet application or byreopening the electronic wallet application after it has been closed).In some embodiments, the second additional information (e.g., 920 ofFIG. 9D) about the second payment transaction comprises the name of theretailer receiving payment as a result of the second paymenttransaction.

At block 1016, in some embodiments, the electronic device displays anavailable credit amount (e.g., how much more can be charged to theaccount before a credit limit for the account will be reached, or howmuch more can be charged to the account before a user-specified budgetfor the account is reached) on the respective representation of thepayment account. For example, the available credit amount indicates theamount of credit available on the payment account based on a creditlimit of the payment account. Displaying the available credit amountallows the user to efficiently determine how much more money can bespent using the payment account.

In some embodiments, the respective representation of the paymentaccount includes a message from the financial institution. Theelectronic device receives a textual message (e.g., 916 of FIG. 9E) fromthe financial institution and displays the textual message from thefinancial institution on the respective representation of the paymentaccount. For example, the message may be an offer for the user or anotification relating to the payment account. The electronic devicereceives selection of the displayed textual message (e.g., useractivates the textual message by tapping on the message), and, inresponse to receiving selection of the displayed textual message, thedevice displays a particular application (e.g., the financialinstitution's banking application) associated with the financialinstitution. For example, the user taps on the textual message (e.g.,916 of FIG. 9E) and the electronic device displays the particularsoftware application related to the financial institution.

In one embodiment, at block 1018, the electronic device displays anaccount detail affordance (e.g., 906 of FIG. 9F) on the respectiverepresentation of the payment account. The electronic device receivesselection of the account detail affordance (e.g., 906 of FIG. 9F), and,in response to receiving selection of the transactions detail affordance(e.g., 906 of FIG. 9F), the electronic device substitutes display of therespective representation of the payment account for display oftransactions details (e.g., 930 of FIG. 9G; the device displays the backof the representation of the payment account to reveal payment historyand additional details) of the payment account, as illustrated inexemplary FIG. 9G. The transactions details (e.g., 930 of FIG. 9G)include the first transaction information (e.g., 950 of FIG. 9G) and thesecond transaction information (e.g., 960 of FIG. 9G). For example, theuser taps on transactions detail affordance 906 and the electronicdevice displays a historical list of transactions for the paymentaccount.

In some embodiments, the transactions details (e.g., 930 of FIG. 9G)comprises a more-transactions affordance (e.g., 954 of FIG. 9G). Theelectronic device receives selection of the more-transactions affordance(e.g., 954 of FIG. 9G), and, in response to receiving selection of themore-transactions affordance, the device displays a third transactioninformation associated with a third payment transaction associated withthe payment account as part of the displayed transactions details (e.g.,the device displays more (or older) transactions for the paymentaccount).

In some embodiments, the transactions details (e.g., 930 of FIG. 9G)comprises a remove-card affordance (e.g., 958 of FIG. 9G). Theelectronic device receives selection of the remove-card affordance, and,in response to receiving selection of the remove-card affordance, theelectronic device displays a confirmation request for removing therespective representation of the payment account from the electronicwallet. The device receives a confirmation to remove the respectiverepresentation of the payment account from the electronic wallet (e.g.,the user activates an affordance confirming that the payment accountshould be removed). The electronic device removes the respectiverepresentation of the payment account from the electronic wallet (e.g.,after receiving the confirmation). Thus, a user can initiate the processto remove the link between the electronic device and a payment accountby tapping on the remove-card affordance.

In some embodiments, transactions details (e.g., 930 of FIG. 9G)comprises an open-application affordance (e.g., 934 of FIG. 9G) foraccessing a particular application or a download-application affordancefor downloading and installing the particular application. Theelectronic device determines whether a particular application (e.g., asoftware application associated with the payment account, such as abanking application) for accessing details of the associated paymentaccount is installed on the electronic device. In accordance with adetermination that the particular application is installed, theelectronic device displays open-application affordance for accessing(such as starting or displaying) the particular application. In someembodiments, in accordance with a determination that the particularapplication is not installed, the electronic device displays adownload-application affordance (e.g. in place of the open-applicationaffordance) for downloading and installing the particular application onthe electronic device. In some embodiments, the electronic devicereceives a selection of the open-application affordance (e.g., a fingertap on the open-application affordance), and, in response to receivingselection of the open-application affordance, the electronic devicecompletely replaces display of the transactions details with display ofthe particular application, as illustrated in FIG. 9H. For example, if auser taps the open-application affordance (e.g., 934 of FIG. 9G), theparticular application is displayed. If a user taps thedownload-application affordance, the particular application isdownloaded or a user interface for downloading the particularapplication is displayed.

In one embodiment, the electronic device receives selection of the firsttransaction information (e.g., 950 of FIG. 9G) of the displayedtransactions details (e.g., 930 of FIG. 9G), and, in response toreceiving selection of the first transaction information (e.g., 950 ofFIG. 9G), the electronic device completely replaces display of thetransactions details (e.g., 930 of FIG. 9G) with display of theparticular application (e.g., 970 of FIG. 9H), as shown in FIG. 9H. Thedisplay of the particular application (e.g., 970 of FIG. 9H) includesdetails (e.g., 972 of FIG. 9H) about the first payment transactionassociated with the payment account.

In some embodiments, the displayed electronic wallet comprises displayof a first stack of card objects and a second stack of card objects, thefirst stack of card objects visually separated from the second stack ofcard objects. The first stack of card objects comprises the respectiverepresentation of the payment account and a second respectiverepresentation of a second payment account. The second stack of cardobjects comprises a membership card object associated with anon-financial institution (e.g., grocery store membership cards, gymmembership cards, coffee store discount cards).

Note that details of the processes described above with respect tomethod 1000 (e.g., FIGS. 10A-10B and 9A-9H) are also applicable in ananalogous manner to the methods described below and above. For example,methods 600, 800, 1200, 1400, 1600, 1800, 2000, and 2200 may include oneor more of the characteristics of the various methods described abovewith reference to method 1000. For brevity, these details are notrepeated below.

The operations described above with reference to the figures may beimplemented by components depicted in FIGS. 1A-1B. For example, displayoperations, detection operations, and receive operations may beimplemented by event sorter 170, event recognizer 180, and event handler190. Event monitor 171 in event sorter 170 detects a contact ontouch-sensitive display 112, and event dispatcher module 174 deliversthe event information to application 136-1. A respective eventrecognizer 180 of application 136-1 compares the event information torespective event definitions 186, and determines whether a first contactat a first location on the touch-sensitive surface corresponds to apredefined event or sub-event, such as selection of an object on a userinterface. When a respective predefined event or sub-event is detected,event recognizer 180 activates an event handler 190 associated with thedetection of the event or sub-event. Event handler 190 may utilize orcall data updater 176 or object updater 177 to update the applicationinternal state 192. In some embodiments, event handler 190 accesses arespective GUI updater 178 to update what is displayed by theapplication. Similarly, it would be clear to a person having ordinaryskill in the art how other processes can be implemented based on thecomponents depicted in FIGS. 1A-1B.

FIGS. 11A-11N illustrate exemplary user interfaces for making a paymenttransaction in accordance with some embodiments. The user interfaces inthese figures are used to illustrate the processes described below,including the process in FIGS. 12A-12C.

FIGS. 11A-11B illustrate exemplary user interfaces for initiating apayment transaction in accordance with some embodiments. At FIG. 11A, anelectronic device 100 displays a user interface for a first application1102 (e.g., a third-party merchant application or a web browser-accessedwebsite). The user interface for the first application 1102 includes apayment affordance 1110 (e.g., a submit button to buy contents of ashopping cart) associated with a payment transaction (e.g., a purchaseto be made). For example, the payment affordance 1110 may be a submitbutton to initiate the purchase of the contents of an electronicshopping cart 1104. In this example, the electronic shopping cart 1104includes multiple clothing items 1106. In some embodiments, the firstapplication is a third-party application installed on the electronicdevice. In some embodiments, the first application includes a websiteaccessed through a web browser installed on the electronic device.

The electronic device detects selection of the payment affordance 1110(e.g., a user taps the payment affordance 1110). In response todetecting selection of the payment affordance 1110, the electronicdevice transfers first transaction information (e.g., descriptions ofitems in the shopping cart, item prices, tax, subtotal, shipping methoddetails) about the payment transaction from the first application 1102(e.g., a third-party merchant application or a web browser-accessedwebsite) to a second application (e.g., operating system or electronicwallet application).

In some embodiments, the second application is the operating system ofthe electronic device, and the second application has access to anelectronic wallet (e.g., the electronic wallet illustrated and describedabove with respect to FIGS. 5A-5I, FIGS. 6A-6C, FIGS. 9A-9H, and FIGS.10A-10B) including second transaction information. In some embodiments,the second application is a first-party application provided by aprovider of the operating system of the electronic device, and thesecond application has access to an electronic wallet (e.g., theelectronic wallet illustrated and described above with respect to FIGS.5A-5I, FIGS. 6A-6C, FIGS. 9A-9H, and FIGS. 10A-10B) including secondtransaction information.

At FIG. 11B, in response to detecting selection of the paymentaffordance 1110, the electronic device displays a user interface for thesecond application 1120. The user interface for the second application1120 includes the first transaction information (e.g., descriptions ofitems in the shopping cart, item prices, tax, subtotal 1132, shippingmethod details) received from the first application and includes secondtransaction information (e.g., indication of payment account 1124, nameassociated with the payment account, billing address, ship-to address1126, and contact information 1130) provided by the second application(e.g., operating system or electronic wallet application). The secondtransaction information is not available to the first application (e.g.,the user has not provided the third-party application with credit card,billing address, shipping address, or contact information).

In some embodiments, displaying the user interface for the secondapplication 1120 (e.g., operating system or electronic walletapplication) partially covers the user interface for the firstapplication 1102 (e.g., a third-party merchant application or a webbrowser-accessed website), leaving at least part of the user interfacefor the first application 1102 visible. The second application onlypartially covers the user interface for the first application so as tohelp the user to maintain context for the transaction. For example, inFIG. 11B, the user interface for the second application 1120 (which, forexample, includes displayed items 1124, 1126, 1128, 1130, 1124A, 1126A,1128A, 1130A, 1132, 1134, 1136, 1138, and 1150) covers the bottomportion of the display of device 100, leaving the top portion of theuser interface for the first application 1102 visible, including part ofthe electronic shopping cart 1104 and one of the clothing items 1106(e.g., the navy blue shirt for $85.00).

In some embodiments, displaying the user interface for the secondapplication 1120 (e.g., operating system or electronic walletapplication) comprises vertically sliding the user interface for thesecond application 1120 (e.g., operating system or electronic walletapplication) onto the display from the bottom of the display topartially cover the user interface for the first application 1102 (e.g.,a third-party merchant application or a web browser-accessed website)and leaving at least part of the user interface for the firstapplication 1102 visible. The second application only partially coversthe user interface for the first application so as to help the user tomaintain context for the transaction. For example, in the transitionbetween FIGS. 11A and 11B, the user interface for the second application1120 (which, for example, includes displayed items 1124, 1126, 1128,1130, 1124A, 1126A, 1128A, 1130A, 1132, 1134, 1136, 1138, and 1150)slides up from the bottom of the display of the device to cover thebottom portion of the display of device 100, leaving the top portion ofthe user interface for the first application 1102 visible, includingpart of the electronic shopping cart 1104 and one of the clothing items1106 (e.g., the navy blue shirt for $85.00).

In some embodiments, the first transaction information includes anamount 1108 (e.g., a subtotal for the shopping cart or the total amountto be paid) and a default shipping method 1128 (e.g., a shipping methodsuch as two-day express mail, first class, ground shipping selected bythe first application). In some embodiments, the second transactioninformation includes a primary account number 1124 (e.g., account numberstored in an electronic wallet) associated with a payment account. Forexample, the payment account may be a payment account linked to theelectronic device, as described above. In some embodiments, the secondtransaction information includes a ship-to address 1126 (e.g., theuser's home mailing address) accessed from user contact information,wherein the user contact information is stored on the electronic device.

FIGS. 11C-11D illustrate exemplary user interfaces for changing anoption of the payment transaction in accordance with some embodiments.In some embodiments, the electronic device receives a selection of(e.g., user taps on) a first purchase detail affordance (e.g., caretassociated with payment account 1124A, shipping address, shippingmethod, contact information) displayed on the user interface for thesecond application 1120. The first purchase detail affordance 1124A isassociated with a first purchase detail (e.g., the selected paymentaccount, shipping address, shipping method, contact information) of thepayment transaction. In response to receiving selection of the firstpurchase detail affordance 1124A, the device displays one or moreaffordances (e.g., displays different options for payment accounts) forselecting an alternate value for the first purchase detail of thepayment transaction. For example, when a user selects caret 1124A inFIG. 11C, which relates to a payment account for the first purchasedetail, the device displays, as illustrated in FIG. 11D, several paymentaccount options 1160 and 1162 for the first purchase detail. Thecurrently selected payment account option 1160 is identified, such as bycheckmark 1164. The device receives a selection of an alternate value(e.g., the user selects payment account option 1162) for the firstpurchase detail of the payment transaction, and, in response toreceiving selection of the alternate value, the device updates thesecond transaction information to include the alternate value as thefirst purchase detail. Thus, the user can change the default paymentaccount 1124 that will be used for the payment transaction.

Similarly, the user can use caret 1126A associated with shippingaddress, caret 1128A associated with shipping method, or caret 1130Aassociated with contact info to change a corresponding purchase detail.For example, a user may change the default shipping address 1126 to thatof a work location, rather than the default shipping address of a homelocation. In another example, the user may change the default shippingmethod 1128 to a different shipping method offered by the firstapplication. In another example, the user may change the default contactinfo 1130 to a different email address.

In some embodiments, the first purchase detail (e.g., price, defaultshipping option) of the payment transaction is part of the firsttransaction information from the first application. In some embodiments,the first purchase detail (e.g., payment account, shipping address,shipping method, contact information) is part of the second transactioninformation. In some embodiments, the first purchase detail is ashipping address. In another embodiment, the first purchase detail is apayment account.

In some embodiments, the electronic device transfers zip codeinformation from the second application to the first application. Insome embodiments, the zip code information is transferred before thetransaction has been authorized, so as to enable the device to providemore accurate shipping cost information to the user before the userdecides to authorize the transaction. The first transaction informationincludes an initial shipping cost based on the zip code information. Thedevice (or the second application) receives updated first transactioninformation, wherein the updated first transaction information includesa shipping cost based on the second transaction information (e.g., theshipping cost is updated based on the user's actual selected shippingaddress).

FIGS. 11E-11L illustrate exemplary user interfaces for receivingauthentication to proceed with a payment transaction in accordance withsome embodiments. In some embodiments, the electronic device receivesauthorization (e.g., receiving a passcode for payment or detecting afingerprint for payment) to proceed with the payment transaction.

FIGS. 11E-F illustrate exemplary user interfaces for receivingauthentication to proceed with a payment transaction using a fingerprintsensor 702 of the electronic device in accordance with some embodiments.At FIG. 11E, the device displays a visual indicator 1150A instructingthe user to provide authentication using fingerprint sensor 702. In someembodiments, receiving authorization to proceed with the paymenttransaction uses the fingerprint sensor 702. The device detects arespective fingerprint on a fingerprint sensor 702 of the electronicdevice. In response to detecting the respective fingerprint on thefingerprint sensor 702, the device determines whether the fingerprint isconsistent with an enrolled fingerprint that is enabled to authorizepayment transactions. In accordance with a determination that arespective fingerprint is consistent with the enrolled fingerprint, thedevice authorizes the payment transaction. In accordance with adetermination that the respective fingerprint is not consistent with theenrolled fingerprint, the devices forgoes authorization of the paymenttransaction. In other words, the device does not authorize the paymenttransaction, meaning authorization is still required to proceed with thepayment transaction.

FIG. 11F illustrates display of a partially filled visual indicator1150B, showing the progress of determining whether the fingerprint isconsistent with the enrolled fingerprint. FIG. 11G illustrates anexemplary user interface when fingerprint authentication fails. In someembodiments, in accordance with a determination that the respectivefingerprint is not consistent with the enrolled fingerprint, the devicedisplays, on the display, an affordance 1154 for receiving authorizationto proceed with the payment transaction using a payment passcode (ratherthan the fingerprint sensor). In some embodiments, in accordance with adetermination that the respective fingerprint is not consistent with theenrolled fingerprint, displaying, on the display, a visual prompt 1150Ainstructing a user to place a finger on the fingerprint sensor.

FIG. 11H illustrates an exemplary user interface for authenticationusing the fingerprint sensor after one or more failed attempts atauthenticating using the fingerprint sensor. In some embodiments, inaccordance with a determination that the respective fingerprint is notconsistent with the enrolled fingerprint, the device determines whethera predetermined number of attempts to receive authorization to proceedwith the payment transaction using the fingerprint sensor has beenreached. In accordance with a determination that the predeterminednumber of attempts to receive authorization has been reached, the devicerequires authorization using a payment passcode to proceed with thepayment transaction, such as illustrated in FIG. 11L. In someembodiments, the predetermined number of attempts is three.

FIGS. 11K-L illustrate various exemplary user interfaces for entry of apayment passcode in accordance with some embodiments. In someembodiments, receiving authorization to proceed with the paymenttransaction comprises receiving authorization using a payment passcode.The device receives a payment passcode at the electronic device (e.g.,using keypad 740 of FIG. 11L). The device determines whether the paymentpasscode is consistent with an enrolled passcode that is enabled toauthorize payment transactions. In response to determining that thepayment passcode is consistent with the enrolled passcode (e.g., apasscode programmed by the user for unlocking the device or for makingpayments), the device authorizes the payment transaction. For example,at FIG. 11K, pay with passcode affordance 1164 is displayed. A userselects the pay with passcode affordance 1164 in order to provideauthorization using a payment passcode. After receiving selection of thepay with passcode affordance 1164, the device displays a (e.g., keypad740 of FIG. 11L) for receiving the payment passcode. The user enters thepayment passcode to provide authorization.

FIG. 11I illustrates an exemplary user interface for indicatingauthorization has been received. The device displays a done affordance1156, indicating that authorization to proceed with the paymenttransaction has been received. In some embodiments, in response toreceiving authorization to proceed with the payment transaction, theelectronic device transfers the second transaction information to thefirst application. In some embodiments, the second transactioninformation is provided to the first application without providing thefirst application with access to other similar information that isaccessible to the second application, such as the user's contacts,payment account information, or shipping information. For example, onlythe specific payment account information or shipping information thatthe user selected to provide to the first application for use inprocessing the current payment transaction is provided to the firstapplication.

In some embodiments, the electronic device receives authorization (e.g.,receiving a passcode for payment or detecting a fingerprint for payment)to proceed with the payment transaction. In response to receivingauthorization to proceed with the payment transaction, the electronicdevice transfers the first transaction information and the secondtransaction information to the first application.

In some embodiments, the electronic device receives the authorization(e.g., receiving a passcode for payment or detecting a fingerprint forpayment) to proceed with the payment transaction prior to transferringthe second transaction information to the first application. The secondtransaction information is not provided to the first application beforethe authorization to proceed with the application has been received, soas to protect the privacy of the user. The privacy of the user isprotected because the first application (e.g., the third-partyapplication) cannot access the sensitive information in the secondtransaction information without the user's consent (e.g., throughauthorizing to proceed with the payment transaction).

FIG. 11J illustrates an exemplary user interface for a completed paymenttransaction. In some embodiments, in response to transferring the firsttransaction information and the second transaction information from thesecond application to the first application, the device completes thepayment transaction. The first application displays, for example, aconfirmation that the transaction has been completed, such asillustrated in FIG. 11J. The confirmation that the transaction has beencompleted may include, for example, the total amount paid and aconfirmation number 1162.

In some embodiments, a financial institution associated with processingthe payment transaction treats the payment transaction as a card-presenttransaction. The financial institution treats the payment transaction asa card-present transaction, as compared to a card-not-presenttransaction, even though there is no physical credit card being swipedat the time of purchase. The financial institution treats the paymenttransaction as a card-present transaction because the paymenttransaction was completed securely. For example, the payment transactionis completed securely because the payment account has been linked to therespective device and completing the payment transaction requires userauthorization (such as through the fingerprint sensor or passcodeentry). As a result of these extra layers of security, the financialinstitution has confidence that the primary account number used in thepayment transaction was provided by the device linked to the paymentaccount.

In some embodiments, a third application can be used to commence asecond payment transaction using the electronic wallet. The devicedisplays a user interface for the third application (e.g., a third-partymerchant application or a different web browser-accessed website). Thethird application is different from the first application and the secondapplication. The user interface for the third application includes asecond payment affordance (e.g., a submit button to buy contents of ashopping cart in the third-party merchant application or the web-browseraccessed website). The second payment affordance is associated with asecond payment transaction (e.g., another purchase to be made using thesecond application). The electronic device detects selection of (e.g.,the user taps on) the second payment affordance, and, in response todetecting selection of the second payment affordance, the electronicdevice transfers third transaction information (e.g., description ofitems in cart, item prices, tax, subtotal, shipping method details)about the second payment transaction from the third application to thesecond application. The electronic device displays a second userinterface for the second application, wherein the second user interfacefor the second application includes the third transaction informationreceived from the third application and includes fourth transactioninformation (e.g., payment account information, name on the paymentaccount, billing address, ship-to address, and/or contact information)provided by the second application (e.g., operating system or electronicwallet application). The fourth transaction information is not availableto the third application. For example, the fourth transactioninformation is not available to the third application because the userhas not previously provided the third application with the paymentaccount information, name on the payment account, billing address,ship-to address, and/or contact information.

FIGS. 11M-11N illustrate exemplary user interfaces for configuring thesettings of an electronic wallet in accordance with some embodiments. Insome embodiments, the electronic device displays a settings menu 1170.The electronic device receives selection of a default shipping addressto be used as a default for the second transaction information. Forexample, the user selects caret 1184, which relates to a ship-toaddress. The user can then enter (and thus the electronic devicereceives) an entry for a default ship-to address (e.g., default shippingaddress) for use with payment transactions.

In some embodiments, the electronic device receives selection from amongat least the payment account 1174 and a second payment account 1176displayed in the settings menu 1170. The selection specifies the defaultpayment account to be used for payment transactions. The selectiondetermines the default payment account that will be used for paymenttransactions.

In some embodiments, the electronic device receives input for defaultcontact information. The input specifies the default contact informationto be used for payment transactions. For example, the user selects caret1186, which relates to contact information. The user can then enter (andthus the electronic device receives) a preferred contact information.The entry determines the default contact information that will be usedfor payment transactions.

FIG. 11N illustrates an exemplary user interface for configuring thesettings of an electronic wallet in accordance with some embodiments. Insome embodiments, the electronic device receives selection of atransaction history display preference (e.g., the transaction historypreference switch 1192) displayed in a settings menu 1170. Theelectronic device determines whether the transaction history displaypreference is enabled, and, in accordance with a determination that thetransaction history display preference is enabled, the device displays ahistory of payment transactions 1194. For example, the history ofpayment transactions 1194 may include multiple previously completedpayment transactions 1196, 1197, and 1198. In another embodiment, whenthe electronic device receives selection of the more-transactionaffordance 1199, the device displays additional previously completedpayment transactions.

In some embodiments, the electronic device receives selection of atransaction history type preference. The transaction history typepreference is displayed in the settings menu. The electronic devicedetermines whether the transaction history type preference is a firsttype, a second type, or a third type. In accordance with a determinationthat the transaction history type preference is the first type, theelectronic device does not display a history of payment transactions fora payment account. In accordance with a determination that thetransaction history type preference is the second type, the electronicdevice displays a history of payment transactions for the paymentaccount completed using only the electronic device. Thus, for example,payment transactions associated with the same payment account, but whichwere completed using another device or a physical credit card are notdisplayed when the transaction history type preference is the secondtype. In accordance with a determination that the transaction historytype preference is the third type, the electronic device displays ahistory of payment transactions for the payment account completed usingthe electronic device and a physical credit card.

FIGS. 12A-12C are flow diagrams illustrating a method for making apayment transaction in accordance with some embodiments. Method 1200 isperformed at a device (e.g., device 300, FIG. 3, or portablemultifunction device 100, FIG. 1) with a display. Some operations inmethod 1200 may be combined, the order of some operations may bechanged, and some operations may be omitted.

As described below, method 1200 provides an intuitive way for making apayment account. The method reduces the cognitive burden on a user whenmaking the payment transaction, thereby creating a more efficienthuman-machine interface. For battery-operated computing devices,enabling a user to make a payment transaction faster and moreefficiently conserves power and increases the time between batterycharges.

At block 1202, an electronic device displays a user interface for afirst application (e.g., a third-party merchant application or a webbrowser-accessed website, 1102 of FIG. 11A). The user interface for thefirst application (e.g., 1102 of FIG. 11A) includes a payment affordance(e.g., a submit button to buy contents of a shopping cart, 1110 of FIG.11A) associated with a payment transaction (e.g., a purchase to bemade). For example, the payment affordance (e.g., 1110 of FIG. 11A) maybe a submit button to initiate the purchase of the contents of anelectronic shopping cart (e.g., 1104 of FIG. 11A).

At block 1204, in some embodiments, the first application is athird-party application installed on the electronic device. At block1206, in some embodiments, the first application includes a websiteaccessed through a web browser installed on the electronic device.

At block 1208, the electronic device detects selection of the paymentaffordance (e.g., a user taps the payment affordance 1110 of FIG. 11A).

At block 1210, the device performs operations in response to detectingselection of the payment affordance (e.g., 1110 of FIG. 11A). At block1212, the electronic device transfers first transaction information(e.g., descriptions of items in the shopping cart, item prices, tax,subtotal, shipping method details) about the payment transaction fromthe first application (e.g., a third-party merchant application or a webbrowser-accessed website, 1102 of FIG. 11A) to a second application(e.g., operating system or electronic wallet application).

At block 1214, in some embodiments, the second application is theoperating system of the electronic device, and the second applicationhas access to an electronic wallet (e.g., the electronic walletillustrated and described above with respect to FIGS. 5A-5I, FIGS.6A-6C, FIGS. 9A-9H, and FIGS. 10A-10B) including second transactioninformation.

At block 1216, in some embodiments, the second application is afirst-party application provided by a provider of the operating systemof the electronic device, and the second application has access to anelectronic wallet (e.g., the electronic wallet illustrated and describedabove with respect to FIGS. 5A-5I, FIGS. 6A-6C, FIGS. 9A-9H, and FIGS.10A-10B) including second transaction information.

At block 1218, in response to detecting selection of the paymentaffordance (e.g., 1110 of FIG. 11A), the electronic device displays auser interface for the second application (e.g., 1120 of FIG. 11B). Theuser interface for the second application (e.g., 1120 of FIG. 11B)includes the first transaction information (e.g., descriptions of itemsin the shopping cart, item prices, tax, subtotal, shipping methoddetails) received from the first application and includes secondtransaction information (e.g., indication of payment account, nameassociated with the payment account, billing address, ship-to address,and contact information) provided by the second application (e.g.,operating system or electronic wallet application). The secondtransaction information is not available to the first application (e.g.,the user has not provided the third-party application with credit card,billing address, shipping address, or contact information).

At block 1220, in some embodiments, displaying the user interface forthe second application (e.g., operating system or electronic walletapplication, 1120 of FIG. 11B) partially covers the user interface forthe first application (e.g., a third-party merchant application or a webbrowser-accessed website, 1102 of FIG. 11B), leaving at least part ofthe user interface for the first application visible. The secondapplication only partially covers the user interface for the firstapplication so as to help the user to maintain context for thetransaction.

At block 1222, in some embodiments, displaying the user interface forthe second application (e.g., operating system or electronic walletapplication, 1120 of FIG. 11B) comprises vertically sliding the userinterface for the second application (e.g., operating system orelectronic wallet application, 1120 of FIG. 11B) onto the display fromthe bottom of the display to partially cover the user interface for thefirst application (e.g., a third-party merchant application or a webbrowser-accessed website, 1102 of FIG. 11B) and leaving at least part ofthe user interface for the first application visible. The user interfacefor the second application only partially covers the user interface forthe first application so as to help the user to maintain context for thetransaction.

In some embodiments, the first transaction information includes anamount (e.g., a subtotal for the shopping cart or the total amount to bepaid) and a default shipping method (e.g., a shipping method such astwo-day express mail, first class, ground shipping selected by the firstapplication). In some embodiments, the second transaction informationincludes a primary account number (e.g., account number stored in anelectronic wallet) associated with a payment account. For example, thepayment account may be a payment account linked to the electronicdevice, as described above. In some embodiments, the second transactioninformation includes a ship-to address (e.g., the user's home mailingaddress) accessed from user contact information, wherein the usercontact information is stored on the electronic device.

At block 1224, in some embodiments, the electronic device receives aselection of (e.g., user taps on) a first purchase detail affordance(e.g., caret associated with payment account, shipping address, shippingmethod, contact information) displayed on the user interface for thesecond application (1120 of FIG. 11C). The first purchase detailaffordance (1124A of FIG. 11C) is associated with a first purchasedetail (e.g., the selected payment account, shipping address, shippingmethod, contact information) of the payment transaction. In response toreceiving selection of the first purchase detail affordance (1124A ofFIG. 11C), the device displays one or more affordances (e.g., displaysdifferent options for payment accounts) for selecting an alternate valuefor the first purchase detail of the payment transaction. The devicereceives a selection of an alternate value (e.g., the user selectspayment account option 1162) for the first purchase detail of thepayment transaction, and, in response to receiving selection of thealternate value, the device updates the second transaction informationto include the alternate value as the first purchase detail. Thus, theuser can change the default payment account that will be used for thepayment transaction.

At block 1226, in some embodiments, the first purchase detail (e.g.,price, default shipping option) of the payment transaction is part ofthe first transaction information from the first application.

At block 1228, in some embodiments, the first purchase detail (e.g.,payment account, shipping address, shipping method, contact information)is part of the second transaction information. In some embodiments, thefirst purchase detail is a shipping address. In some embodiments, thefirst purchase detail is a payment account.

In some embodiments, the electronic device transfers zip codeinformation from the second application to the first application. Insome embodiments, the zip code information is transferred before thetransaction has been authorized, so as to enable the device to providemore accurate shipping cost information to the user before the userdecides to authorize the transaction. The first transaction informationincludes an initial shipping cost based on the zip code information. Thedevice (or the second application) receives updated first transactioninformation, wherein the updated first transaction information includesa shipping cost based on the second transaction information (e.g., theshipping cost is updated based on the user's actual selected shippingaddress).

At block 1230, in some embodiments, the electronic device receivesauthorization (e.g., receiving a passcode for payment or detecting afingerprint for payment) to proceed with the payment transaction.

At block 1232, in some embodiments, receiving authorization to proceedwith the payment transaction uses the fingerprint sensor. The devicedetects a respective fingerprint on a fingerprint sensor of theelectronic device. In response to detecting the respective fingerprinton the fingerprint sensor, the device determines whether the fingerprintis consistent with an enrolled fingerprint that is enabled to authorizepayment transactions. In accordance with a determination that arespective fingerprint is consistent with the enrolled fingerprint, thedevice authorizes the payment transaction. In accordance with adetermination that the respective fingerprint is not consistent with theenrolled fingerprint, the device forgoes authorization of the paymenttransaction. In other words, the device does not authorize the paymenttransaction, meaning authorization is still required to proceed with thepayment transaction.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint,the device displays, on the display, an affordance (e.g., 1154 of FIG.11G) for receiving authorization to proceed with the payment transactionusing a payment passcode (rather than the fingerprint sensor). In someembodiments, in accordance with a determination that the respectivefingerprint is not consistent with the enrolled fingerprint, displaying,on the display, a visual prompt (e.g., 1150A of FIG. 11G) instructing auser to place a finger on the fingerprint sensor.

In some embodiments, in accordance with a determination that therespective fingerprint is not consistent with the enrolled fingerprint,the device determines whether a predetermined number of attempts toreceive authorization to proceed with the payment transaction using thefingerprint sensor has been reached. In accordance with a determinationthat the predetermined number of attempts to receive authorization hasbeen reached, the device requires authorization using a payment passcodeto proceed with the payment transaction. In some embodiments, thepredetermined number of attempts is three.

At block 1234, in some embodiments, receiving authorization to proceedwith the payment transaction comprises receiving authorization using apayment passcode. The device receives a payment passcode at theelectronic device (e.g., using keypad 740 of FIG. 11L). The devicedetermines whether the payment passcode is consistent with an enrolledpasscode that is enabled to authorize payment transactions. In responseto determining that the payment passcode is consistent with the enrolledpasscode (e.g., a passcode programmed by the user for unlocking thedevice or for making payments), the device authorizes the paymenttransaction.

At block 1236, in some embodiments, the device performs a series ofoperations in response to receiving authorization to proceed with thepayment transaction. At block 1238, in some embodiments, the electronicdevice transfers the second transaction information to the firstapplication. In some embodiments, the second transaction information isprovided to the first application without providing the firstapplication with access to other similar information that is accessibleto the second application, such as the user's contacts, payment accountinformation, or shipping information. For example, only the specificpayment account information or shipping information that the userselected to provide to the first application for use in processing thecurrent payment transaction is provided to the first application.

At block 1240, in some embodiments, in response to receivingauthorization to proceed with the payment transaction, the electronicdevice transfers the first transaction information and the secondtransaction information to the first application.

In some embodiments, the electronic device receives the authorization(e.g., receiving a passcode for payment or detecting a fingerprint forpayment) to proceed with the payment transaction prior to transferringthe second transaction information to the first application. The secondtransaction information is not provided to the first application beforethe authorization to proceed with the application has been received soas to protect the privacy of the user. The privacy of the user isprotected because the first application (e.g., the third-partyapplication) cannot access the sensitive information in the secondtransaction information without the user's consent (e.g., throughauthorizing to proceed with the payment transaction).

In some embodiments, in response to transferring the first transactioninformation and the second transaction information from the secondapplication to the first application, the device completes the paymenttransaction.

At block 1242, in some embodiments, a financial institution associatedwith processing the payment transaction treats the payment transactionas a card-present transaction. The financial institution treats thepayment transaction as a card-present transaction, as compared to acard-not-present transaction, even though there is no physical creditcard being swiped at the time of purchase. The financial institutiontreats the payment transaction as a card-present transaction because thepayment transaction was completed securely. For example, the paymenttransaction is completed securely because the payment account has beenlinked to the respective device and completing the payment transactionrequires user authorization (such as through the fingerprint sensor orpasscode entry). As a result of these extra layers of security, thefinancial institution has confidence that the primary account numberused in the payment transaction was provided by the device linked to thepayment account.

At block 1244, in some embodiments, a third application can be used tocommence a second payment transaction using the electronic wallet. Thedevice displays a user interface for the third application (e.g., athird-party merchant application or a different web browser-accessedwebsite). The third application is different from the first applicationand the second application. The user interface for the third applicationincludes a second payment affordance (e.g., a submit button to buycontents of a shopping cart in the third-party merchant application orthe web-browser accessed website). The second payment affordance isassociated with a second payment transaction (e.g., another purchase tobe made using the second application). The electronic device detectsselection of (e.g., the user taps on) the second payment affordance,and, in response to detecting selection of the second paymentaffordance, the electronic device transfers third transactioninformation (e.g., description of items in cart, item prices, tax,subtotal, shipping method details) about the second payment transactionfrom the third application to the second application. The electronicdevice displays a second user interface for the second application,wherein the second user interface for the second application includesthe third transaction information received from the third applicationand includes fourth transaction information (e.g., payment accountinformation, name on the payment account, billing address, ship-toaddress, and/or contact information) provided by the second application(e.g., operating system or electronic wallet application). The fourthtransaction information is not available to the third application. Forexample, the fourth transaction information is not available to thethird application because the user has not previously provided the thirdapplication with the payment account information, name on the paymentaccount, billing address, ship-to address, and/or contact information.

In some embodiments, the electronic device displays a settings menu(e.g., 1170 of FIG. 11M). The electronic device receives selection of adefault shipping address to be used as a default for the secondtransaction information.

In some embodiments, the electronic device receives selection from amongat least the payment account (e.g., 1174 of FIG. 11M) and a secondpayment account (e.g., 1176 of FIG. 11M) displayed in the settings menu(e.g., 1170 of FIG. 11M). The selection specifies the default paymentaccount to be used for payment transactions. The selection determinesthe default payment account that will be used for payment transactions.

In some embodiments, the electronic device receives input for defaultcontact information. The input specifies the default contact informationto be used for payment transactions.

In some embodiments, the electronic device receives selection of atransaction history display preference (e.g., the transaction historypreference switch 1192 of FIG. 11N) displayed in a settings menu (e.g.,1170 of FIG. 11N). The electronic device determines whether thetransaction history display preference is enabled, and, in accordancewith a determination that the transaction history display preference isenabled, the device displays a history of payment transactions (e.g.,1194 of FIG. 11N). For example, the history of payment transactions(e.g., 1194 of FIG. 11N) may include multiple previously completedpayment transactions (e.g., 1196, 1197, and 1198 of FIG. 11N). Inanother embodiment, when the electronic device receives selection of themore-transaction affordance (e.g., 1199 of FIG. 11N), the devicedisplays additional previously completed payment transactions.

In some embodiments, the electronic device receives selection of atransaction history type preference. The transaction history typepreference is displayed in the settings menu. The electronic devicedetermines whether the transaction history type preference is a firsttype, a second type, or a third type. In accordance with a determinationthat the transaction history type preference is the first type, theelectronic device does not display a history of payment transactions fora payment account. In accordance with a determination that thetransaction history type preference is the second type, the electronicdevice displays a history of payment transactions for the paymentaccount completed using only the electronic device. Thus, for example,payment transactions associated with the same payment account, but whichwere completed using another device or a physical credit card are notdisplayed when the transaction history type preference is the secondtype. In accordance with a determination that the transaction historytype preference is the third type, the electronic device displays ahistory of payment transactions for the payment account completed usingthe electronic device and a physical credit card.

Note that details of the processes described above with respect tomethod 1200 (e.g., FIGS. 12A-12C and 11A-11N) are also applicable in ananalogous manner to the methods described above. For example, methods600, 800, 1000, 1400, 1600, 1800, 2000, and 2200 may include one or moreof the characteristics of the various methods described above withreference to method 1200. For brevity, these details are not repeatedbelow.

The operations in the information processing methods described above maybe implemented by running one or more functional modules in informationprocessing apparatus such as general purpose processors or applicationspecific chips. These modules, combinations of these modules, and/ortheir combination with general hardware (e.g., as described above withrespect to FIGS. 1A, 1B and 3) are all included within the scope ofprotection of the invention.

The operations described above with reference to the figures may beimplemented by components depicted in FIGS. 1A-1B. For example,detection operations, display operations, and determination operationsmay be implemented by event sorter 170, event recognizer 180, and eventhandler 190. Event monitor 171 in event sorter 170 detects a contact ontouch-sensitive display 112, and event dispatcher module 174 deliversthe event information to application 136-1. A respective eventrecognizer 180 of application 136-1 compares the event information torespective event definitions 186, and determines whether a first contactat a first location on the touch-sensitive surface corresponds to apredefined event or sub-event, such as selection of an object on a userinterface. When a respective predefined event or sub-event is detected,event recognizer 180 activates an event handler 190 associated with thedetection of the event or sub-event. Event handler 190 may utilize orcall data updater 176 or object updater 177 to update the applicationinternal state 192. In some embodiments, event handler 190 accesses arespective GUI updater 178 to update what is displayed by theapplication. Similarly, it would be clear to a person having ordinaryskill in the art how other processes can be implemented based on thecomponents depicted in FIGS. 1A-1B.

FIGS. 13A-13D illustrate exemplary user interfaces for selecting apayment account from among available payment accounts using anelectronic device in accordance with some embodiments. The userinterfaces in these figures are used to illustrate the processesdescribed below, including the process in FIG. 14.

FIGS. 13A-13B illustrate an exemplary technique for providing paymentfor a payment transaction. In these examples, the payment is providingusing a short-range communication radio, such as a NFC radio. The NFCstandards, which are related to radio-frequency identification (RFID)standards, describe communication protocols for transferring informationbetween two devices, such as for making payments. It should beappreciated, however, that other communications standards and techniquesmay also be used.

Device 100 (and device 300) may include near field communicationscircuitry, such as a short range communication radio. Accordingly,device 100 can wirelessly communicate with external equipment, such asNFC-enabled contactless payment transaction terminal 1300, using nearfield communications.

In FIG. 13A, the NFC-enabled contactless payment transaction terminal1300 generates a field 1302. For example, an NFC-enabled device thatenters the field 1302 can communicate with the contactless paymenttransaction terminal 1300 using NFC. In FIG. 13A, the electronic device100 has not been placed in the field 1302. The contactless paymenttransaction terminal 1300 may be part of a payment system (e.g., checkregister) installed in a retail store for processing paymenttransactions, such as purchases of products and services.

In FIG. 13B, the user places the electronic device 100 into the field1302. The electronic device detects, by the short-range communicationradio of the electronic device, presence of the field 1302 (e.g., theNFC compliant RF field) generated by the contactless payment transactionterminal 1300 (e.g., an NFC-compliant payment transaction terminal). Insome embodiments, the electronic device detects the field andcommunication initiation signal from the contactless payment transactionterminal 1300. The device communicates with the contactless paymenttransaction terminal 1300 to authorize the payment transaction.

In some embodiments, a user can make a purchase from any location whereaccess to a network, such as the Internet, is available. For example, auser can access a software application at electronic device 100 with anInternet connection to initiate communication with a remote paymentprocessing terminal to make a payment in a payment transaction.

In some embodiments, the electronic device is device 100. In someembodiments, the electronic device is device 300. The device has adisplay (e.g., 112, 340), a processor (e.g., 120, 310), and memory(e.g., 102, 370) storing one or more programs for execution by theprocessor.

FIG. 13C illustrates an exemplary user interface that includesrepresentations of a plurality of payment accounts that are linked tothe electronic device (e.g., 100). The plurality of payment accountsincludes a first payment account (e.g., 1304) and a second paymentaccount (e.g., 1306) that is different from the first payment account(e.g., 1304).

The device receives a payment transaction request of a paymenttransaction, wherein the first payment account (e.g., 1304) and thesecond payment account (e.g., 1306) are both available to providepayment for the payment transaction. For example, the detection of thefield 1302 and/or the communication initiation signal may be a paymenttransaction request. For another example, the payment transactionrequest is the user authorizing a payment. For another example, thepayment transaction request is a user activating an affordance forreviewing a purchase summary (e.g., listing of items to be purchased andhow payment will be made) prior to authorizing the payment.

In response to receiving the payment transaction request, the deviceobtains payment account selection information (e.g., current locationinformation, current time, currently schedule calendar event). Inaccordance with a determination, based on the payment account selectioninformation, that first payment transaction criteria are met, the deviceprovides payment in the payment transaction using the first paymentaccount (e.g., 1304). For example, the device transmits the primaryaccount number of a first credit card to a contactless paymenttransaction terminal or to an online payment processor. In accordancewith a determination, based on the payment account selectioninformation, that second payment transaction criteria are met, thedevice provides payment in the payment transaction using the secondpayment account (e.g., 1306). For example, the device transmits theprimary account number of a second credit card to a contactless paymenttransaction terminal or to an online payment processor.

FIG. 13D illustrates an exemplary user interface displayed after paymenthas been provided. In this example, the first payment transactioncriteria were met. Accordingly, the device provided payment in thepayment transaction using the first payment account (e.g., 1304).

In accordance with some embodiments, different payment accounts havedifferent primary account numbers. In accordance with some embodiments,the first payment account is associated with a first primary accountnumber and the second payment account is associated with a secondprimary account number that is different than the first primary accountnumber. Providing payment in the payment transaction comprises using arespective primary account number to authorize payment. For example, ifthe first payment account (e.g., 1304) is used, the device transmits thefirst primary account number to the contactless payment transactionterminal (1300) or to the online payment processor. For another example,if the second payment account (e.g., 1306) is used, the device transmitsthe second primary account number to the contactless payment transactionterminal (1300) or to the online payment processor.

In accordance with some embodiments, the payment account selectioninformation comprises current location information of the electronicdevice. For example, the device provides the first payment account(e.g., 1304) when the user of the device is in their home country, andthe device provides the second payment account (e.g., 1306) when theuser of the device is traveling through a second country. In someexamples, this allows the device to automatically select the appropriatepayment account based on the location of the device, thereby reducingthe need for the user to navigate a complex user interface to selectfrom among various payment accounts.

In accordance with some embodiments, the payment account selectioninformation comprises types of acceptable payment accounts. For example,the device provides a primary American Express account when AmericanExpress cards are accepted. If American Express cards are not accepted,then the device selects a primary Mastercard if Mastercard is accepted.If both American Express and Mastercard are not accepted, the deviceselects a primary Visa account if Visa cards are accepted.

In accordance with some embodiments, the payment account selectioninformation comprises a time of day or day of week. For example, thisallows the device to use a personal credit card account for workexpenses during the daytime of the work week and use a personal creditcard account for personal expenses in the evenings and on weekends.

In accordance with some embodiments, the payment account selectioninformation comprises a currently scheduled electronic calendar event.For example, the device uses a corporate credit card account duringscheduled work events such as work lunches and business trips and uses apersonal credit card account at other times.

In accordance with some embodiments, the payment account selectioninformation comprises identification of other devices within a definedproximity to the electronic device. For example, when the user is at arestaurant and the user's spouse's phone is detected within the definedproximity, the device uses a credit card or payment account associatedwith a joint account. When the user is at a restaurant with a co-worker,supervisor, or subordinate, the device uses a corporate credit card orpayment account. When the user is at a restaurant without any knowncontacts nearby, the device uses a personal credit card or paymentaccount.

In accordance with some embodiments, the payment account selectioninformation comprises identification of a retailer (or type of retailer)requesting the payment transaction. For example, the device uses a firstpayment account (e.g., 1304) at a first retailer and a second paymentaccount (e.g., 1306) at a different retailer. For another example, thedevice uses a credit card or payment account that is associated withautomobile maintenance at a gas station or auto repair shop and use acredit card or payment account that is associated with grocery purchasesat a grocery store.

In accordance with some embodiments, the payment account selectioninformation comprises one or more items being purchased as part of thepayment transaction. For example, the device identifies the items beingpurchased and uses a first payment account (e.g., 1304) for a purchaseof gas at a gas station, and uses a second payment account (e.g., 1306)for purchase of food at a different purchase transaction at the same gasstation.

In accordance with some embodiments, the payment account selectioninformation comprises one or more promotions associated with one or moreof the payment accounts. For example, a primary American Express accountis selected when the device has received information indicating that apromotional discount will be applied to purchases made with an AmericanExpress card for certain types of purchases or for purchases made atcertain retailers.

In accordance with some embodiments, the device provides a notificationat the electronic device (e.g., audio, haptic, or both) based on a metpayment transaction criteria. The notification indicates a respectivepayment account to be used for providing payment in the paymenttransaction. For example, the device provides a custom haptic or audioalert for each different payment account to alert the user as to whichpayment account has been selected. In some embodiments, the deviceprovides a same haptic and/or audio alert whenever the device selects apayment account that is different from a default payment account. Thisnotifies the user that a payment account other than the default paymentaccount will be used for the payment transaction.

In accordance with some embodiments, the first payment account is adefault payment account and the second payment account is different thanthe default payment account. For example, the first payment transactioncriteria include one or more criteria that are met when there are noconditions that override the default payment account, and the secondpayment transaction criteria include one or more criteria that are metwhen a condition overrides the default payment account in favor of thesecond payment account.

In accordance with some embodiments, the device receives identificationof the first payment account as a default payment account from anelectronic wallet, wherein the electronic wallet comprisesrepresentations of the plurality of payment accounts (e.g., 1304, 1306,1308). For example, the device includes an electronic walletapplication, which includes information regarding the plurality ofpayment accounts and indicates which payment account of the plurality ofpayment accounts is a default payment account.

In accordance with some embodiments, the first payment account (e.g.,1304) is associated with a first credit card and the second paymentaccount (e.g., 1306) is associated with a second credit card. Forexample, the first payment account (e.g., 1304) has been linked with afirst credit card from AA Bank such that payments made using the firstpayment account appear on the same revolving credit bill as the firstcredit card from AA Bank.

FIG. 14 is a flow diagram illustrating method 1400 for selecting apayment account from among available payment accounts in accordance withsome embodiments. Method 1400 is performed at a device (e.g., 100, 300).The device has a display (e.g., 112, 340), a processor (e.g., 120, 310),and memory (e.g., 102, 370) storing one or more programs for executionby the processor. Some operations in method 1400 may be combined, theorder of some operations may be changed, and some operations may beomitted.

As described below, method 1400 provides an intuitive way to select apayment account from among available payment accounts when making apayment. The method reduces the cognitive burden on a user when making apayment, thereby creating a more efficient human-machine interface. Forbattery-operated computing devices, enabling make a payment faster andmore efficiently conserves power and increases the time between batterycharges.

At block 1402, a plurality of payment accounts are linked to theelectronic device. The plurality of payment accounts include a firstpayment account (e.g., 1304) and a second payment account (e.g., 1306)that is different from the first payment account.

At block 1404, a payment transaction request of a payment transaction isreceived. The first payment account (e.g., 1305) and the second paymentaccount (e.g., 1306) are both available to provide payment for thepayment transaction.

At block 1406, in response to receiving the payment transaction request,payment account selection information is obtained at block 1408 (e.g.,current location information, current time, currently schedule calendarevent).

At block 1410, in accordance with a determination, based on the paymentaccount selection information, that first payment transaction criteriaare met, payment in the payment transaction is provided using the firstpayment account (e.g., the device transmits the primary account numberof a first credit card to a contactless payment transaction terminal orto an online payment processor).

At block 1412, in accordance with a determination, based on the paymentaccount selection information, that second payment transaction criteriaare met, payment in the payment transaction is provided using the secondpayment account (e.g., the device transmits the primary account numberof a second credit card to a contactless payment transaction terminal orto an online payment processor).

Note that details of the processes described above with respect tomethod 1400 (e.g., FIGS. 14 and 13A-13D) are also applicable in ananalogous manner to the methods described below and above. For example,methods 600, 800, 1000, 1200, 1600, 1800, 2000, and 2200 may include oneor more of the characteristics of the various methods described abovewith reference to method 1400. For brevity, these details are notrepeated below.

FIG. 15 illustrates an exemplary user interface for displaying anindication of a digital item associated with a purchased item using anelectronic device (e.g., 100, 300) in accordance with some embodiments.The techniques and user interfaces in these figures are used toillustrate the processes described below, including the process in FIG.16.

FIG. 15 illustrates an exemplary user interface indicating that apayment transaction has been authorized for a purchased item (e.g.,T1000 Video Game Console 1502). The device (e.g., 100) authorizes apayment transaction for the purchased item (e.g., a good or a real-worldservice) using a payment account (e.g., 1504) linked to the electronicdevice. The purchased item is selected from the set comprising: aphysical good and a real-world service. For example, the user purchasesa product (e.g., T1000 Video Game Console) at a retail store (e.g.,Tim's Toy Store) using near field communications. After authorizing thepayment transaction, the device determines that the purchased item isassociated with a digital item (e.g., a digital good or service; acontroller software application for the T1000 Video Game Console),wherein the digital item is different from the purchased item, and thedevice displays an indication of the digital item (e.g., affordance1506) that is associated with the purchased item. For example, theprocesses described in relation to FIGS. 14 and 13A-13D can be used todetermine the payment account used to purchase of the product.

In accordance with some embodiments, the digital item (the controllersoftware application) was not a part of the payment transaction (e.g.,it was not purchased or licensed as part of the payment transaction).

In accordance with some embodiments, the payment transaction isauthorized based on communication (e.g., via NFC technology) with apayment terminal in a physical retail location, such as a brick andmortar store, a concert venue, or other physical business.

In accordance with some embodiments, displaying the indication of thedigital item includes displaying a prompt to download the digital item(e.g., prompt 1508). For example, the device prompts the user todownload an application for controlling a media playback device that waspurchased by the user. For another example, the device prompts the userto install a concert venue application or to download to a documentreader a map of a concert venue when a concert ticket is purchased.

In accordance with some embodiments, while displaying the prompt (e.g.,1508) to download the digital item, the device detects selection of aconfirmation affordance (e.g., affordance 1506). In response todetecting selection of the confirmation affordance (e.g., 1506), thedevice downloads the digital item to the device. Optionally, the devicealso installs the digital item on the device. For example, the deviceprompts the user to download an application for controlling a mediaplayback device that was purchased by the user. For another example, thedevice prompts the user to install a concert venue application or todownload to a document reader a map of a concert venue if a concertticket was purchased.

In accordance with some embodiments, while displaying the prompt, thedevice detects selection of a cancellation affordance (e.g., 1510). Inresponse to detecting selection of the cancellation affordance (e.g.,1510), the device forgoes downloading of the digital item to the device.For example, the user indicates a preference to not download the digitalitem.

In accordance with some embodiments, displaying the indication of thedigital item comprises downloading the digital item to the device. Forexample, the device downloads an application for controlling a mediaplayback device that was purchased by the user using the electronicdevice, or the device downloads to a document reader a map of a concertvenue if a concert ticket was purchased using the electronic device.

In accordance with some embodiments, the digital item is anadvertisement or coupon that is displayed on the display of theelectronic device.

In accordance with some embodiments, the indication of the digital itemis displayed in response to the authorization of the payment transactionthat was completed by the device (e.g., not in response to receiving aconfirmatory communication from a retailer). For example, the digitalitem is not a confirmation email or text message from the retailer. Inresponse to authorizing the payment transaction, the device generates anotification at the device based on the payment transaction. Forexample, the notification is generated even where the retailer does nothave the capability to send a communication to the device, such as theretailer not having an email address or phone number that is associatedwith the device.

In accordance with some embodiments, the determination of the digitalitem that is associated with the purchased item is based on informationfrom a manufacturer of the purchased item, and the manufacturer of thepurchased item is different from a seller of the purchased item.

In accordance with some embodiments, the purchased item is a physicalgood and the digital item is an application. For example, theapplication is configured to communicate with the physical good, such asto electronically control the physical good.

In accordance with some embodiments, the purchased item is an admissionticket to an event at a venue and the digital item includes additionalinformation about the venue (e.g., a map, schedule, etc.).

FIG. 16 is a flow diagram illustrating a method 1600 for displaying anindication of a digital item associated with a purchased item inaccordance with some embodiments. Method 1600 is performed at a device(e.g., 100, 300). The device has a display (e.g., 112, 340), a processor(e.g., 120, 310), and memory (e.g., 102, 370) storing one or moreprograms for execution by the processor. Some operations in method 1600may be combined, the order of some operations may be changed, and someoperations may be omitted.

As described below, method 1600 provides an intuitive way to display anindication of a digital item associated with a purchased item. Themethod reduces the cognitive burden on a user when making a purchase ofan item that has an associated digital item, thereby creating a moreefficient human-machine interface. For battery-operated computingdevices, enabling a user to view an indication of a digital itemassociated with a purchased item faster and more efficiently conservespower and increases the time between battery charges.

At block 1602, a payment transaction is authorized for a purchased item(e.g., a good or a real-world service) using a payment account linked tothe electronic device. The purchased item is selected from the setcomprising: a physical good and a real-world service (e.g., the userpurchases a product at a retail store using near field communications).

After authorizing the payment transaction, at block 1604, it isdetermined that the purchased item is associated with a digital item(e.g., a digital good or service). The digital item is different fromthe purchased item.

After authorizing the payment transaction, at block 1606, an indicationof the digital item (e.g., 1506) that is associated with the purchaseditem is displayed.

Note that details of the processes described above with respect tomethod 1600 (e.g., FIGS. 15 and 16) are also applicable in an analogousmanner to the methods described below and above. For example, methods600, 800, 1000, 1200, 1400, 1800, 2000, and 2200 may include one or moreof the characteristics of the various methods described above withreference to method 1600. For brevity, these details are not repeatedbelow.

FIGS. 17A-17B illustrate exemplary user interfaces for initiating apayment transaction with participants of an ongoing communication usingan electronic device (e.g., 100, 300) in accordance with someembodiments. The user interfaces in these figures are used to illustratethe processes described below, including the process in FIG. 18.

In FIG. 17A, the device displays a user interface for a communicationapplication that includes a user interface indicative of ongoingcommunication (e.g., a phone call, a text or multimedia messagingconversation 1702, an email thread) between a user of the device and oneor more other participants (e.g., 1704). For example, the one or moreother participants may be participants of a conversation in a messagingapplication, participants of an email in a mail application, orparticipants of an event in a calendar application. The user interfacefor the communication application includes a payment affordance (e.g.,1706). For example, the payment affordance may indicate “Make Payment”.

While displaying the user interface indicative of the ongoingcommunication, the device detects activation of the payment affordance(e.g., 1706). In response to detecting activation of the paymentaffordance (e.g., 1706), the device initiates a payment transactionbetween the user and the one or more other participants in the ongoingcommunication. In the example of FIG. 17A, the only other participant inthe ongoing message communication is M. Smith. For example, theprocesses described in relation to FIGS. 14 and 13A-13D can be used todetermine the payment account used to initiate the payment transactionbetween the user and the one or more other participants.

In accordance with some embodiments, initiating the payment transactioncomprises transferring recipient information from the communicationapplication to a second application, wherein the recipient informationidentifies the one or more other participants in the ongoingcommunication.

As illustrated in FIG. 17B, in accordance with some embodiments, thedevice displays a user interface for the second application (e.g., apayment processing application), wherein the user interface for thesecond application (e.g., 1708) indicates the one or more otherparticipants (e.g., 1710) in the ongoing communication. The deviceproceeds with the payment transaction using the second application(e.g., the payment processing application) and a payment account linkedto the electronic device.

In accordance with some embodiments, the communication application andthe second application are different applications. In accordance withsome embodiments, the user interface for the communication applicationincludes displayed representations of the one or more other participantsin the ongoing communication (e.g., 1704).

In accordance with some embodiments, the payment transaction isinitiated along with another communication (e.g., a text message, email,or phone call).

In accordance with some embodiments, initiating the payment transactioncomprises: determining the quantity of the one or more otherparticipants; and in accordance with a determination that the quantityof the one or more participants is one, enabling the user to initiatethe payment transaction without explicitly identifying the recipient ofthe payment. For example, the device receives user input indicating anamount of the payment transaction and forgoes receiving user inputindicating recipients of the payment transaction. For example, thedevice receives an input indicting the amount, but does not ask forrecipients because there is only one recipient—the one otherparticipant.

In accordance with some embodiments, initiating the payment transactioncomprises: determining the quantity of the one or more otherparticipants, and in accordance with a determination that the quantityof the one or more participants is greater than one, requesting userinput indicating an amount of the payment transaction and user inputindicating the one or more other participants are recipients of thepayment transaction. For example, if there are multiple participants,the user selects one or more of the participants for payment beforeinitiating the payment transaction.

In accordance with some embodiments, the communication application is amessaging application and the one or more other participants areparticipants of a displayed conversation. In accordance with someembodiments, the communication application is an electronic mailapplication and the one or more other participants are participants of adisplayed electronic mail. In accordance with some embodiments, thecommunication application is a phone application and the one or moreother participants are participants of an active phone conversation. Inaccordance with some embodiments, the communication application is acalendar application and the one or more other participants are inviteesof a displayed calendar event. In accordance with some embodiments, thecommunication application is a calendar application and the one or moreother participants are invitees of a displayed calendar event that haveaccepted the displayed calendar event.

In accordance with some embodiments, initiating the payment transactionincludes requesting user input indicating an amount of the paymenttransaction.

In accordance with some embodiments, the one or more other participantsare within a defined proximity to the electronic device. For example,the device provides a quick and easy way to send payments to members ofa calendar invite who are currently at the restaurant with the user(e.g., within a defined proximity), so “pay user” affordances aredisplayed only for members of the calendar invite who are in closeproximity to the user and not for members of the calendar invite who arenot in close proximity to the user.

FIG. 18 is a flow diagram illustrating method 1800 for method forinitiating a payment transaction with participants of an ongoingcommunication in accordance with some embodiments. Method 1800 isperformed at a device (e.g., 100, 300). The device has a display (e.g.,112, 340), a processor (e.g., 120, 310), and memory (e.g., 102, 370)storing one or more programs for execution by the processor. Someoperations in method 1800 may be combined, the order of some operationsmay be changed, and some operations may be omitted.

As described below, method 1800 provides an intuitive way for initiatinga payment transaction with participants of an ongoing communication inaccordance with some embodiments. The method reduces the cognitiveburden on a user when initiating payments, thereby creating a moreefficient human-machine interface. For battery-operated computingdevices, enabling a user to initiate payments faster and moreefficiently conserves power and increases the time between batterycharges.

At block 1802, a user interface for a communication application thatincludes a user interface (e.g., 1702) indicative of ongoingcommunication (e.g., a phone call, a text or multimedia messagingconversation, an email thread) between a user of the device and one ormore other participants (e.g., 1704 “M. Smith”) is displayed. The userinterface for the communication application includes a paymentaffordance (e.g., 1706).

At block 1804, while displaying the user interface (e.g., 1702)indicative of the ongoing communication, activation of the paymentaffordance (e.g., 1706) is detected.

At block 1806, in response to detecting activation of the paymentaffordance (e.g., 1706), a payment transaction is initiated between theuser and the one or more other participants (e.g., 1704) in the ongoingcommunication.

In accordance with some embodiments, the processes described in relationto FIGS. 14 and 13A-13D can be used to determine the payment accountused to initiate the payment transaction between the user and the one ormore other participants.

Note that details of the processes described above with respect tomethod 1800 (e.g., FIGS. 18 and 17A-17B) are also applicable in ananalogous manner to the methods described below and above. For example,methods 600, 800, 1000, 1200, 1400, 1600, 2000, and 2200 may include oneor more of the characteristics of the various methods described abovewith reference to method 1800. For brevity, these details are notrepeated below.

FIG. 19 illustrates an exemplary user interface for making a paymenttransaction using an electronic device (e.g., 100, 300) in accordancewith some embodiments. The user interfaces are used to illustrate theprocesses described below, including the process in FIG. 20.

The device displays a user interface (e.g., 1902) for a firstapplication (e.g., map application or web browser application thatdisplays information about goods or services). The user interface (e.g.,1902) for the first application includes information identifying aplurality of retailers (e.g., 1904A-1904C for selecting items topurchase). The device receives a request to initiate a paymenttransaction with a first retailer of the plurality of retailers (e.g.,user taps on the purchase selection affordance 1906). In response toreceiving the request to initiate a payment transaction with the firstretailer: in accordance with a determination that an application of thefirst retailer (e.g., an application designated by the first retailerfor handling payment transactions from mobile devices, such as anapplication that is branded with the brand of the first retailer) isavailable on the device, the device invokes the application of the firstretailer, wherein the application of the first retailer enables the userto initiate a payment transaction with the first retailer (e.g., thefirst retailer's application is displayed and provides options formaking the purchase), and in accordance with a determination that anapplication of the first retailer is not available on the device, thedevice provides the user with an option for proceeding with the paymenttransaction without invoking the application of the first retailer(e.g., a separate application not provided by the retailer is invokedand provides options for making the purchase).

In some embodiments, in accordance with a determination that theapplication of the first retailer is not available on the device and isavailable for download, the device displays a download affordance (e.g.,1908) associated with the application of the retailer. For example, thedownload affordance, when activated, initiates a download (and/orinstallation) of the application of the first retailer to the electronicdevice.

In accordance with some embodiments, the application of the firstretailer is not available when it is not installed on the device. Forexample, the application of the first retailer is determined to be notavailable even if the application of the first retailer is available fordownload.

In some embodiments, in accordance with a determination that theapplication of the first retailer is not available on the device, thedevice determines whether the application of the first retailer isavailable for download. In accordance with a determination that theapplication of the first retailer is available for download, the devicedisplays a download affordance (e.g., 1908) associated with theapplication of the retailer. The download affordance, when activated,initiates a download (and/or installation) of the application of thefirst retailer to the electronic device. In accordance with adetermination that an application of the first retailer is not availablefor download, the device provides the user with the option forproceeding with the payment transaction without invoking an applicationof the retailer (e.g., a separate application not provided by theretailer is invoked and provides options for making the purchase).

In accordance with some embodiments, providing the user with the optionfor proceeding with the payment transaction without invoking anapplication of the first retailer comprises: determining a type of thefirst retailer, selecting a first template from among a plurality oftemplates based on the type of the first retailer, and displaying one ormore items (e.g., goods or services) of the first retailer using theselected first template.

In accordance with some embodiments, the device provides the user withthe option for proceeding with a second payment transaction with asecond retailer of the plurality of retailers without invoking anapplication of the second retailer by: determining a type of the secondretailer, selecting a second template from among the plurality oftemplates based on the type of the second retailer, displaying one ormore items (e.g., goods or services) of the second retailer using theselected second template, and wherein the first template and the secondtemplate are the same when the type of the first retailer and the typeof the second retailer are the same.

In accordance with some embodiments, the first template and the secondtemplate are different when the type of the first retailer and the typeof the second retailer are different.

In accordance with some embodiments, providing the user with the optionfor proceeding with the payment transaction without invoking anapplication of the retailer comprises invoking a second application. Theapplication of the first retailer, the first application, and the secondapplication are different applications.

In accordance with some embodiments, the first retailer populates theselected first template with the one or more items. For example, thefirst retailer populates the template such as by specifying the itemsthat the retailer sells and their cost.

In accordance with some embodiments, publicly available information isused to populate the selected first template with the one or more items.For example, a menu is retrieved from public website and used topopulate the selected first template.

In accordance with some embodiments, the device receives a request toauthorize the payment transaction. In response to receiving the requestto authorize the payment transaction, the device authorizes the paymenttransaction.

In accordance with some embodiments, the first application is a mapsapplication or a browser application.

In accordance with some embodiments, the second application includes apayment affordance for proceeding with the payment transaction using apayment account linked to the electronic device.

Examples of types of retailers include: event retailers, such as movietheaters and concert venues; eating establishments, such as restaurants,bars, and coffee shops; transportation companies, such as taxis, buses,trains, and airlines; lodging establishments, such as motels and hotels;and clothing stores, such as dress stores and shoe stores.

An example template for the lodging establishment may include, forexample, the number of rooms, the booking dates, the size of bed (e.g.,queen or king), the number of beds (e.g., 1 or 2), the check-in time,and the link. An example template for transportation companies mayinclude, for example, the expected departure and arrival time, thenumber of passengers, the class of seat (e.g., coach, business, andfirst class). An example template for an event retailer may include, forexample, the date of the function, the type of seat (e.g., upper deck,lower deck, and general admission), the number of tickets, the ticketpickup type (e.g., will call, print-at-home, email, and postal mail). Anexample template for an eating establishment may include, for example,the types of food, the types of drinks, the size of drinks, andavailable reservation dates and times.

FIG. 20 is a flow diagram illustrating a method for invoking anapplication of a retailer based on the availability of the applicationin accordance with some embodiments. Method 2000 is performed at adevice (e.g., 100, 300) with a display. Some operations in method 2000may be combined, the order of some operations may be changed, and someoperations may be omitted.

As described below, method 2000 provides an intuitive way for invokingan application of a retailer. The method reduces the cognitive burden ona user when making a payment transaction, thereby creating a moreefficient human-machine interface. For battery-operated computingdevices, enabling a user to make a payment transaction faster and moreefficiently conserves power and increases the time between batterycharges.

At block 2002, a user interface (e.g., 1902) for a first application isdisplayed (e.g., map application or web browser application thatdisplays information about goods or services). The user interface (e.g.,1902) for the first application includes information identifying aplurality of retailers (e.g., 1904A-1904C).

At block 2004, a request to initiate a payment transaction with a firstretailer (e.g., 1904B) of the plurality of retailers (e.g., 1904A-1904C)is received (e.g., user taps on the purchase selection affordance).

At block 2006, in response to receiving the request to initiate apayment transaction with the first retailer: at block 2008, inaccordance with a determination that an application of the firstretailer (e.g., an application designated by the first retailer forhandling payment transactions from mobile devices, such as anapplication that is branded with the brand of the first retailer) isavailable on the device, the application of the first retailer isinvoked. The application of the first retailer enables the user toinitiate a payment transaction with the first retailer (e.g., the firstretailer's application is displayed and provides options for making thepurchase). At block 2010, in accordance with a determination that anapplication of the first retailer is not available on the device, theuser is provided with an option for proceeding with the paymenttransaction without invoking the application of the first retailer(e.g., a separate application not provided by the retailer is invokedand provides options for making the purchase).

In accordance with some embodiments, the processes described in relationto FIGS. 14 and 13A-13D can be used to determine the payment accountused to initiate the payment transaction with the first retailer.

Note that details of the processes described above with respect tomethod 2000 (e.g., FIGS. 19 and 20) are also applicable in an analogousmanner to the methods described below and above. For example, methods600, 800, 1000, 1200, 1400, 1600, 1800, and 2200 may include one or moreof the characteristics of the various methods described above withreference to method 2000. For brevity, these details are not repeatedbelow.

FIG. 21 illustrates an exemplary user interface for providing a purchaserecommendation using an electronic device (e.g., 100, 300) in accordancewith some embodiments. The user interface is used to illustrate theprocesses described below, including the process in FIG. 22.

The device obtains a history of payment transactions associated with oneor more payment accounts linked to the device (e.g., purchases madeusing the payment accounts, such as by using the electronic device tomake the purchases). The device determines a current location of thedevice (e.g., using GPS). The device determines, based on at least aportion of the history of payment transactions and the current locationof the device, a suggested product (or service) for purchase from aretailer (e.g., a retailer that is proximate to the current location ofthe device). The device displays an indication (e.g., 2102) of thesuggested product for purchase. The device displays an affordance (e.g.,2104) associated with a payment transaction of the suggested product(e.g., a “purchase” affordance for purchasing the suggested product).

While displaying the affordance (e.g., 2104) associated with the paymenttransaction, the device detects activation of the affordance (e.g.,2104) associated with the payment transaction. In response to detectingactivation of the affordance associated with the payment transaction,the device initiates a process for authorizing the payment transactionof the suggested product (e.g., displaying a purchase user interfaceindicating the suggested product and a price of the suggested product,or authorizing purchase of the suggested product).

In accordance with some embodiments, the device detects a fingerprint ona fingerprint sensor of the electronic device. In response to detectingthe fingerprint on the fingerprint sensor, the device determines whetherthe fingerprint is consistent with an enrolled fingerprint that isenabled to authorize payment transactions. In accordance with adetermination that a respective fingerprint is consistent with theenrolled fingerprint, the device authorizes the payment transaction. Inaccordance with a determination that the respective fingerprint is notconsistent with the enrolled fingerprint, the device forgoesauthorization of the payment transaction (e.g., the device does notauthorize the payment transaction, meaning authorization is stillrequired to proceed with the payment transaction).

In accordance with some embodiments, the displayed indication of thesuggested product for purchase is displayed without explicit user inputrequesting a suggestion (e.g., the indication of the suggested producthappens automatically).

In accordance with some embodiments, the displayed indication of thesuggested product for purchase is displayed in response to an explicituser input requesting a suggestion (e.g., asking a personal assistantfor suggestions).

In accordance with some embodiments, the displayed indication of thesuggested product for purchase is displayed in response to an implicituser input (e.g., the user turning toward a store window and lookinginto the store window and then pulling out the device, looking at thedisplay of the device or unlocking the device, and opening a mapsapplication or a digital personal assistant application on the device).

In accordance with some embodiments, the suggested product (or service)for purchase from the retailer is determined based on a current time ofday (or day of week).

In accordance with some embodiments, the suggested product (or service)for purchase from the retailer is determined based on the orientation ofthe device (e.g., the suggestion is based on which business the user isfacing, as determined by a direction that a back of the device isfacing).

In accordance with some embodiments, while displaying the indication ofthe suggested product for purchase, the device displays the name andbusiness hours (e.g., 2106) of the retailer.

In accordance with some embodiments, while displaying the indication ofthe suggested product for purchase, the device displays one or morereviews for the suggested product.

In accordance with some embodiments, while displaying the indication ofthe suggested product for purchase, the device displays an affordancefor purchasing a second suggested product, the second suggested productdetermined based on the suggested product and one or more reviews of thesecond suggested product.

In accordance with some embodiments, while displaying the indication ofthe suggested product for purchase, the device displays an affordancefor purchasing a third suggested product, the third suggested productdetermined based on the current location.

In accordance with some embodiments, the device authorizes the paymenttransaction of the suggested product using a secure element integratedinto the electronic device.

In accordance with some embodiments, the suggested product is a coffee.The device receives confirmation of completion of the paymenttransaction of the coffee. The device transmits purchase details of thecoffee to the retailer (e.g., sending coffee size and flavor preferencesto the retailer before or after finalizing the payment). The devicedisplays an indication of the availability for pickup of the coffee atthe retailer (e.g., when the retailer has indicated that the coffee isavailable for pickup and/or when the retailer indicates a predicted timeat which the coffee will be available for pickup).

FIG. 22 is a flow diagram illustrating a method for providing a purchaserecommendation using an electronic device in accordance with someembodiments. Method 2200 is performed at a device (e.g., 100, 300) witha display. Some operations in method 2200 may be combined, the order ofsome operations may be changed, and some operations may be omitted.

As described below, method 2200 provides an intuitive way for providinga purchase recommendation. The method reduces the cognitive burden on auser for receiving a recommendation and making a purchase, therebycreating a more efficient human-machine interface. For battery-operatedcomputing devices, enabling a user to access a purchase recommendationfaster and more efficiently conserves power and increases the timebetween battery charges.

At block 2202, a history of payment transactions associated with one ormore payment accounts linked to the device is obtained (e.g., purchasesmade using the payment accounts, such as by using the electronic deviceto make the purchases).

At block 2204, a current location of the device is determined (e.g.,using GPS).

At block 2206, based on at least a portion of the history of paymenttransactions and the current location of the device, a suggested product(or service) for purchase from a retailer is determined (e.g., aretailer that is proximate to the current location of the device).

At block 2208, an indication of the suggested product (e.g., 2102) forpurchase is displayed.

At block 2210, an affordance (e.g., 2104) associated with a paymenttransaction of the suggested product is displayed (e.g., a “purchase”button for purchasing the suggested product).

At block 2212, while displaying the affordance (e.g., 2104) associatedwith the payment transaction, activation of the affordance (e.g., 2104)associated with the payment transaction is detected.

At block 2214, in response to detecting activation of the affordance(e.g., 2104) associated with the payment transaction, a process forauthorizing the payment transaction of the suggested product isinitiated (e.g., displaying a purchase user interface indicating thesuggested product and a price of the suggested product, or authorizingpurchase of the suggested product).

In accordance with some embodiments, the processes described in relationto FIGS. 14 and 13A-13D can be used to determine the payment accountused in the process for authorizing the payment transaction.

Note that details of the processes described above with respect tomethod 2200 (e.g., FIGS. 21 and 22) are also applicable in an analogousmanner to the methods described above. For example, methods 600, 800,1000, 1200, 1400, 1600, 1800, and 2000 may include one or more of thecharacteristics of the various methods described above with reference tomethod 2200. For brevity, these details are not repeated below.

FIG. 23 shows exemplary functional blocks of an electronic device 2300that, in some embodiments, perform the features described above. Asshown in FIG. 23, an electronic device 2300 includes a display unit 2302configured to display graphical objects; a touch-sensitive surface unit2304 configured to receive user gestures (e.g., touches); one or more RFunits 2306 configured to detect and communicate with external electronicdevices; and a processing unit 2308 coupled to display unit 2302,touch-sensitive surface unit 2304, and RF units 2306. In someembodiments, the processing unit 2308 includes a display enabling unit2310, a receiving unit 2312, a determining unit 2314, a linking unit2316, an obtaining unit 2318, a providing unit 2320, an authorizing unit2322, a detecting unit 2324, an initiating unit 2326, an invoking unit2328, a proceeding unit 2330, and a transferring unit 2332. The units ofFIG. 23 may be used to implement the various techniques and methodsdescribed above with respect to FIGS. 5-22.

For example, the display enabling unit 2310 can be used for: displayingan indication of the digital item that is associated with the purchaseditem; displaying a user interface for a communication application thatincludes a user interface indicative of ongoing communication between auser of the device and one or more other participants; displaying a userinterface for a first application; and displaying an indication of thesuggested product for purchase; displaying an affordance associated witha payment transaction of the suggested product; displaying, on thedisplay, an electronic wallet comprising a respective representation ofa payment account, wherein the respective representation of the paymentaccount includes first transaction information for a first paymenttransaction associated with the payment account; displaying secondtransaction information for the second payment transaction, the secondtransaction information based on information locally available to theelectronic device; displaying, on the display, a user interface for afirst application, wherein the user interface for the first applicationincludes a payment affordance associated with a payment transaction; anddisplaying, on the display, a user interface for the second application,wherein the user interface for the second application includes the firsttransaction information received from the first application and includessecond transaction information provided by the second application,wherein the second transaction information is not available to the firstapplication.

For example, the receiving unit 2312 can be used for: receiving apayment transaction request of a payment transaction, wherein the firstpayment account and the second payment account are both available toprovide payment for the payment transaction; and receiving a request toinitiate a payment transaction with a first retailer of the plurality ofretailers; receiving a request to link a payment account associated witha credit card to a respective device, wherein the request includesinformation about the credit card.

For example, the determining unit 2314 can be used for: determining thatthe purchased item is associated with a digital item, wherein thedigital item is different from the purchased item; determining a currentlocation of the device; determining, based on at least a portion of thehistory of payment transactions and the current location of the device,a suggested product for purchase from a retailer; determining whetherfurther verification is needed to link the payment account to therespective device; and determining whether authorization to proceed witha payment transaction is provided.

For example, the linking unit 2316 can be used for: linking a pluralityof payment accounts to the electronic device, wherein the plurality ofpayment accounts include a first payment account and a second paymentaccount that is different from the first payment account; and linkingthe payment account to the respective device and providing an indicationthat the payment account has been linked to the respective device.

For example, the obtaining unit 2318 can be used for: obtaining paymentaccount selection information; and obtaining a history of paymenttransactions associated with one or more payment accounts linked to thedevice.

For example, the providing unit 2320 can be used for: providing paymentin the payment transaction using the first payment account; providingpayment in the payment transaction using the second payment account;providing the user with an option for proceeding with the paymenttransaction without invoking the application of the first retailer;providing an indication that further verification is needed to link thepayment account to the respective device; providing an indicationrequesting authorization to proceed with the payment transaction.

For example, the authorizing unit 2322 can be used for: authorizing apayment transaction for a purchased item using a payment account linkedto the electronic device.

For example, the detecting unit 2324 can be used for: detectingactivation of the payment affordance; detecting activation of theaffordance associated with the payment transaction; detecting, by theshort-range communication radio, presence of a field generated by acontactless payment transaction terminal; detecting a second paymenttransaction associated with the payment account using the electronicdevice; and detecting selection of the payment affordance.

For example, the initiating unit 2326 can be used for: initiating apayment transaction between the user and the one or more otherparticipants in the ongoing communication; and initiating a process forauthorizing the payment transaction of the suggested product.

For example, the invoking unit 2328 can be used for: invoking theapplication of the first retailer.

For example, the proceeding unit 2330 can be used for: proceeding withthe payment transaction with the contactless payment transactionterminal.

For example, the transferring unit 2332 can be used for: transferringfirst transaction information about the payment transaction from thefirst application to a second application.

The functional blocks of the device 2300 are, optionally, implemented byhardware, software, or a combination of hardware and software to carryout the principles of the various described examples. It is understoodby persons of skill in the art that the functional blocks described inFIG. 23 are, optionally, combined or separated into sub-blocks toimplement the principles of the various described examples. Therefore,the description herein optionally supports any possible combination orseparation or further definition of the functional blocks describedherein.

The operations described above with reference to the figures may beimplemented by components depicted in FIGS. 1A-1B, 2, 3 and 23. Forexample, detection operations, display operations, and determinationoperations may be implemented by event sorter 170, event recognizer 180,and event handler 190. Event monitor 171 in event sorter 170 detects acontact on touch-sensitive display 112, and event dispatcher module 174delivers the event information to application 136-1. A respective eventrecognizer 180 of application 136-1 compares the event information torespective event definitions 186, and determines whether a first contactat a first location on the touch-sensitive surface corresponds to apredefined event or sub-event, such as activation of an affordance on auser interface. When a respective predefined event or sub-event isdetected, event recognizer 180 activates an event handler 190 associatedwith the detection of the event or sub-event. Event handler 190 mayutilize or call data updater 176 or object updater 177 to update theapplication internal state 192. In some embodiments, event handler 190accesses a respective GUI updater 178 to update what is displayed by theapplication. Similarly, it would be clear to a person having ordinaryskill in the art how other processes can be implemented based on thecomponents depicted in FIGS. 1A-1B, 2, 3 and 23.

The foregoing description, for purpose of explanation, has beendescribed with reference to specific embodiments. However, theillustrative discussions above are not intended to be exhaustive or tolimit the invention to the precise forms disclosed. Many modificationsand variations are possible in view of the above teachings. Theembodiments were chosen and described in order to best explain theprinciples of the invention and its practical applications, to therebyenable others skilled in the art to best utilize the invention andvarious embodiments with various modifications as are suited to theparticular use contemplated.

As described above, one aspect of the present technology is thegathering and use of data available from various sources to improve thedelivery to users of invitational content or any other content that maybe of interest to them. The present disclosure contemplates that in someinstances, this gathered data may include personal information data thatuniquely identifies or can be used to contact or locate a specificperson. Such personal information data can include demographic data,location-based data, telephone numbers, email addresses, home addresses,or any other identifying information.

The present disclosure recognizes that the use of such personalinformation data, in the present technology, can be used to the benefitof users. For example, the personal information data can be used todeliver targeted content that is of greater interest to the user.Accordingly, use of such personal information data enables calculatedcontrol of the delivered content. Further, other uses for personalinformation data that benefit the user are also contemplated by thepresent disclosure.

The present disclosure further contemplates that the entitiesresponsible for the collection, analysis, disclosure, transfer, storage,or other use of such personal information data will comply withwell-established privacy policies and/or privacy practices. Inparticular, such entities should implement and consistently use privacypolicies and practices that are generally recognized as meeting orexceeding industry or governmental requirements for maintaining personalinformation data private and secure. For example, personal informationfrom users should be collected for legitimate and reasonable uses of theentity and not shared or sold outside of those legitimate uses. Further,such collection should occur only after receiving the informed consentof the users. Additionally, such entities would take any needed stepsfor safeguarding and securing access to such personal information dataand ensuring that others with access to the personal information dataadhere to their privacy policies and procedures. Further, such entitiescan subject themselves to evaluation by third parties to certify theiradherence to widely accepted privacy policies and practices.

Despite the foregoing, the present disclosure also contemplatesembodiments in which users selectively block the use of, or access to,personal information data. That is, the present disclosure contemplatesthat hardware and/or software elements can be provided to prevent orblock access to such personal information data. For example, in the caseof advertisement delivery services, the present technology can beconfigured to allow users to select to “opt in” or “opt out” ofparticipation in the collection of personal information data duringregistration for services. In another example, users can select not toprovide location information for targeted content delivery services. Inyet another example, users can select to not provide precise locationinformation, but permit the transfer of location zone information.

Therefore, although the present disclosure broadly covers use ofpersonal information data to implement one or more various disclosedembodiments, the present disclosure also contemplates that the variousembodiments can also be implemented without the need for accessing suchpersonal information data. That is, the various embodiments of thepresent technology are not rendered inoperable due to the lack of all ora portion of such personal information data. For example, content can beselected and delivered to users by inferring preferences based onnon-personal information data or a bare minimum amount of personalinformation, such as the content being requested by the deviceassociated with a user, other non-personal information available to thecontent delivery services, or publically available information.

What is claimed is:
 1. An electronic device, comprising: a display; atouch-sensitive surface; one or more processors; and memory storing oneor more programs configured to be executed by the one or moreprocessors, the one or more programs including instructions for:displaying, on the display, a user interface that concurrently displayscontent and a transaction affordance associated with a securetransaction related to the content; while displaying the user interface,detecting, via the touch-sensitive surface, an activation of thetransaction affordance; in response to detecting the activation of thetransaction affordance, displaying, on the display, a transactionoverlay that covers the transaction affordance and at least a firstportion of the content without covering a second portion of the content,wherein the transaction overlay includes a representation of an accountfor use in the secure transaction; and while displaying the transactionoverlay, displaying, in the transaction overlay, instructions forauthenticating the secure transaction.
 2. The electronic device of claim1, wherein the electronic device includes a biometric sensor, andwherein the instructions for authenticating the secure transactioninclude instructions for providing biometric authentication, via thebiometric sensor, to authenticate the secure transaction.
 3. Theelectronic device of claim 2, wherein the biometric sensor is afingerprint sensor, and wherein the instructions for authenticating thesecure transaction include a graphical representation of a simulatedfingerprint.
 4. The electronic device of claim 2, wherein the one ormore programs further include instructions for: while displaying, in thetransaction overlay, the instructions for providing biometricauthentication, receiving, via the biometric sensor, biometricinformation; and in response to receiving the biometric information, inaccordance with a determination that the biometric information isconsistent with registered biometric information, displaying, on thedisplay, confirmation information associated with the securetransaction, wherein the displayed confirmation information replacesdisplay of the transaction overlay.
 5. The electronic device of claim 4,wherein the displayed confirmation information further replaces displayof the second portion of the content of the user interface.
 6. Theelectronic device of claim 4, wherein the one or more programs furtherinclude instructions for: in response to receiving the biometricinformation, in accordance with a determination that the biometricinformation is inconsistent with the registered biometric information,maintaining display of the transaction overlay without displaying theconfirmation information.
 7. The electronic device of claim 4, whereinthe one or more programs further include instructions for: in responseto receiving the biometric information, in accordance with adetermination that the biometric information is inconsistent with theregistered biometric information: maintaining display of the transactionoverlay; and displaying, in the transaction overlay, an affordance forauthenticating the secure transaction using passcode authentication. 8.The electronic device of claim 1, wherein the instructions forauthenticating the secure transaction include a graphic representationindicative of a method of biometric authentication.
 9. The electronicdevice of claim 1, wherein the instructions for authenticating thesecure transaction include text instructions for providing biometricauthentication.
 10. The electronic device of claim 1, wherein the one ormore programs further include instructions for: while displaying, in thetransaction overlay, the instructions for authenticating the securetransaction, wherein the instructions for authenticating the securetransaction include instructions for providing biometric authentication,concurrently displaying, in the transaction overlay: shippinginformation related to the secure transaction, and account informationassociated with the account for use in the secure transaction.
 11. Theelectronic device of claim 10, wherein the one or more programs furtherinclude instructions for: while displaying, in the transaction overlay,the shipping information and the account information, concurrentlydisplaying, in the transaction overlay, a first affordance for changingthe shipping information and a second affordance for changing theaccount information.
 12. A non-transitory computer-readable storagemedium storing one or more programs configured to be executed by one ormore processors of an electronic device with a display and atouch-sensitive surface, the one or more programs including instructionsfor: displaying, on the display, a user interface that concurrentlydisplays content and a transaction affordance associated with a securetransaction related to the content; while displaying the user interface,detecting, via the touch-sensitive surface, an activation of thetransaction affordance; in response to detecting the activation of thetransaction affordance, displaying, on the display, a transactionoverlay that covers the transaction affordance and at least a firstportion of the content without covering a second portion of the content,wherein the transaction overlay includes a representation of an accountfor use in the secure transaction; and while displaying the transactionoverlay, displaying, in the transaction overlay, instructions forauthenticating the secure transaction.
 13. A method, comprising: at anelectronic device with a display and a touch-sensitive surface:displaying, on the display, a user interface that concurrently displayscontent and a transaction affordance associated with a securetransaction related to the content; while displaying the user interface,detecting, via the touch-sensitive surface, an activation of thetransaction affordance; in response to detecting the activation of thetransaction affordance, displaying, on the display, a transactionoverlay that covers the transaction affordance and at least a firstportion of the content without covering a second portion of the content,wherein the transaction overlay includes a representation of an accountfor use in the secure transaction; and while displaying the transactionoverlay, displaying, in the transaction overlay, instructions forauthenticating the secure transaction.